-- Logs begin at Wed 2022-08-31 11:04:34 UTC, end at Wed 2022-08-31 12:09:48 UTC. -- Aug 31 11:34:28.939369 dv-cinder-839768-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 11:34:28.949256 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 11:34:28.951250 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 11:34:28 2022] *** Aug 31 11:34:28.951250 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 11:34:28.951250 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 11:34:28.951250 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: nodename: dv-cinder-839768-3-iscsi Aug 31 11:34:28.951250 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: machine: x86_64 Aug 31 11:34:28.951250 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: clock source: unix Aug 31 11:34:28.951250 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: pcre jit disabled Aug 31 11:34:28.951250 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: detected number of CPU cores: 4 Aug 31 11:34:28.951250 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: current working directory: / Aug 31 11:34:28.951250 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: detected binary path: /usr/bin/uwsgi-core Aug 31 11:34:28.951850 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: your processes number limit is 47680 Aug 31 11:34:28.951850 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: your memory page size is 4096 bytes Aug 31 11:34:28.951850 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: detected max file descriptor number: 2048 Aug 31 11:34:28.951850 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: lock engine: pthread robust mutexes Aug 31 11:34:28.951850 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: thunder lock: enabled Aug 31 11:34:28.951850 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 11:34:28.951850 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 11:34:28.990738 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: Python main interpreter initialized at 0x557818d329c0 Aug 31 11:34:28.990738 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: python threads support enabled Aug 31 11:34:28.990738 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: your server socket listen backlog is limited to 100 connections Aug 31 11:34:28.990738 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: your mercy for graceful operations on workers is 90 seconds Aug 31 11:34:28.991077 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 11:34:28.991154 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: *** Operational MODE: preforking *** Aug 31 11:34:28.991396 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: *** uWSGI is running in multiple interpreter mode *** Aug 31 11:34:28.991396 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: spawned uWSGI master process (pid: 112042) Aug 31 11:34:28.991573 dv-cinder-839768-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 11:34:28.992363 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: spawned uWSGI worker 1 (pid: 112043, cores: 1) Aug 31 11:34:28.992466 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: spawned uWSGI worker 2 (pid: 112044, cores: 1) Aug 31 11:34:28.992641 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 11:34:29.652508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 11:34:29.653103 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 11:34:30.744050 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:34:30.744050 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: from cryptography.utils import int_from_bytes Aug 31 11:34:30.744696 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:34:30.744696 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: from cryptography.utils import int_from_bytes Aug 31 11:34:30.745685 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:34:30.745685 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: from cryptography.utils import int_from_bytes Aug 31 11:34:30.746115 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:34:30.746115 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: from cryptography.utils import int_from_bytes Aug 31 11:34:33.227092 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 11:34:33.227791 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 11:34:33.227890 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 11:34:33.228191 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 11:34:33.228445 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 11:34:33.228865 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 11:34:33.229242 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.229334 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 11:34:33.229416 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.229545 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.229634 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 11:34:33.229866 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.229961 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 11:34:33.230192 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.230278 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 11:34:33.230501 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.230604 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.230821 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.230914 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.231139 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.231224 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.231464 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.231566 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.231722 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.231810 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.232034 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.232120 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.232355 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-3-iscsi {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.232449 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.232701 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.232788 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.233008 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.233125 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.233300 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.233431 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.233616 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.233745 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.233916 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.234058 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-3-iscsi {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.234236 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.234371 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.234526 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.234650 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.234833 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.235032 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.235180 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.236301 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.236520 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.236520 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.236915 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.237105 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.237304 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.237480 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.237669 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.237870 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.238066 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.238216 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.238437 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.238588 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.238774 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.238960 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.239177 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.239363 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.239520 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.239698 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.239914 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.240100 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-3-iscsi {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.240283 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.241026 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.241329 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.241557 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.241718 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.241877 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.242003 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.242159 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.242293 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-3-iscsi {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.242449 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.242582 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.242707 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.242844 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.242981 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.243151 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.243279 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.243409 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.243555 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.243682 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.243805 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.243928 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.244060 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.244194 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.244319 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.244450 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.244623 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.244748 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.244872 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.245005 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.245130 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.245130 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.245376 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.245501 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.245624 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.245757 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.245882 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.246012 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.246142 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.246268 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.246398 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.246532 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.246657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.246780 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.246903 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.247026 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.247190 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.247355 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.247485 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.247609 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.247742 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.247875 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.248010 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.248135 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.248259 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.248388 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.248550 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.248697 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.248824 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.248957 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.249089 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.249089 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.249339 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.249339 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.249585 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.249709 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.249832 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.249957 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.250093 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.250218 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.250349 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.250474 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.250597 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.250720 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.250851 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.250982 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.251106 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.251106 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.251345 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.251477 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.251614 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.251739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.251869 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.251993 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.252116 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.252240 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.252445 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.252584 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.252708 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.252832 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.252966 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.253105 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.253230 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.253230 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.253474 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.253474 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.253709 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.253840 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.253965 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.254088 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.254218 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.254342 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.254475 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.254614 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.254738 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.254861 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.254984 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.255114 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.255238 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.255415 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.255552 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.255685 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.255811 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.256013 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.256733 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.257025 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.257170 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.257369 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.257567 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.257702 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.257887 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.258017 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.258196 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.258323 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.258506 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.258634 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.258807 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.258936 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.259111 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.259248 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.259416 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.259542 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.259716 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.259847 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.260014 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.260142 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.260317 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.260444 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.260642 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.260771 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.260945 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.261074 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.261248 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.261386 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.261552 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.261681 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.261853 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.261996 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.262155 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.262294 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.262459 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.262595 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.262760 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.262898 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.263060 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.263197 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.263365 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.263495 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.263665 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.263793 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.263968 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.264110 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.264269 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.264400 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.264615 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.264754 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.264919 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.265057 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.265222 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.265359 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.265539 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.265669 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.265845 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.265983 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.266149 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.266280 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.266464 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.266592 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.266761 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.266899 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.267063 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.267194 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.267375 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.267504 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.267680 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.267822 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.267983 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.268111 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.268284 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.268411 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.268597 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.268725 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.268896 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.269025 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.269198 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.269328 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.269498 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.269628 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.269798 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.269932 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.270091 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.270219 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.270393 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.270521 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.270695 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.270823 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.270998 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.271126 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.271296 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.271426 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.271771 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.271914 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.272041 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.272328 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.272473 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.272636 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.272763 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.272897 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.273023 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.273158 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.273284 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:34:33.273409 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.273535 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.273679 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.273818 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.274011 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.274361 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.274484 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.274592 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.274707 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.274824 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.274934 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.275078 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.275240 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.275382 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.275551 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.275691 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.275868 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.276001 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.276166 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.276304 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.276503 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.276650 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.276826 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.276955 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.277157 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.277294 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.277510 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.277651 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.277791 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.277918 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.278085 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.278216 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.278395 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.278533 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.278711 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.278849 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.279039 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.279169 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.279348 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.279490 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.279659 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.279788 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.279985 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.280106 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.280307 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.280436 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.280639 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.280783 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.280970 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.281098 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.281291 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.281421 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.281601 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.281731 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.281911 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.282041 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.282220 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.282350 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.282530 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.282658 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.282842 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.282973 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.283154 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.283284 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.283471 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.283598 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.283781 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.283919 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.284097 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.284225 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.284406 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.284553 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.284741 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.284879 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.285048 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.285182 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.285362 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.285491 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.285671 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.285813 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.285984 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.286131 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.286298 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.286430 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.286610 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.286752 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.286923 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.287051 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.287761 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.288319 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.288458 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.288623 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.288623 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.288861 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.288986 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.289110 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.289253 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.289380 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.289503 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.289627 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.289751 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.289882 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.290020 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.290153 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.290287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.290423 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.290549 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.290673 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.290806 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.290932 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.291063 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.291231 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.291362 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.291537 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.291675 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.291868 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.292008 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.292174 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.292304 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.292482 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.292684 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.292814 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.292993 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.293122 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.293308 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.293448 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.293620 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.293758 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.293931 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.294071 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.294238 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.294381 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.294551 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.294689 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.294863 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.295001 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.295170 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.295340 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.295493 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.295621 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.295800 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.295936 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.296104 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.296232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.296418 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.296565 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.296750 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.296889 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.297060 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.297189 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.297371 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.297500 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.297682 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.297816 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.297996 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.298134 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.298305 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.298441 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.298616 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.298745 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.298945 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.299076 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.299258 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.299387 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.299564 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.299702 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.299890 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.300028 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.300216 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.300346 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.300549 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.300694 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.300845 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.300973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.301160 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.301288 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.301462 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.301599 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.301766 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.301904 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.302069 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.302207 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.302371 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.302580 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.302708 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.302926 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.303159 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.303287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.303422 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.303547 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.303671 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.303796 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.303933 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.304067 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.304232 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.304393 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.304559 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.304738 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.304868 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.305042 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.305184 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.305348 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.305484 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.305651 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.305788 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.305992 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.306133 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.306299 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.306428 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.306640 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.306778 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.306949 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.307079 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.307281 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.307417 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.307604 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.307733 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.307914 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.308051 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.308229 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.308358 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.308560 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.308703 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.308874 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.309005 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.309181 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.309309 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.309489 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.309617 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.309799 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.309938 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.310108 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.310245 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.310427 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.310554 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.310733 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.310861 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.311051 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.311190 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.311358 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.311500 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.311677 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.311806 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.311980 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.312110 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.312295 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.312437 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.312602 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.312727 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.312923 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.313052 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.313265 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.313409 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.313588 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.313716 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.313900 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.314038 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.314214 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.314352 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.314523 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.314651 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.314831 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.314965 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.315139 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.315261 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.315446 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.315581 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.315752 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.315880 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.316060 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.316195 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.316375 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.316525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.316707 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.316838 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.317026 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.317165 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.317333 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.317461 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.317652 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.317780 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.317952 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.318088 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.318268 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.318398 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.319142 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.319281 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.319418 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.319546 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.319980 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.320114 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.320313 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.320453 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.320640 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.320768 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.320946 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.321075 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.321268 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.321411 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.321578 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.321710 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.321881 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.322016 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.322184 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.322323 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.322483 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.322611 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.322786 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.322924 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.323094 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.323232 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.323402 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.323531 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.323705 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.323835 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.324012 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.324140 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.324314 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.324443 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.324640 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.324769 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.324945 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.325083 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.325255 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.325392 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.325578 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.325706 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.325888 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.326019 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.326207 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.326334 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.326517 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.326654 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.326818 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.326948 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.327121 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.327251 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.327432 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.327570 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.327737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.327867 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.328049 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.328175 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.328326 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.328465 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.328653 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.328780 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.328961 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.329091 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.329270 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.329413 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.329572 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.329700 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.329886 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.330015 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.330204 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.330345 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.330510 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.330638 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.330824 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.330953 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.331132 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.331261 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.331442 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.331578 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.331751 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.331879 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.332082 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.332212 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.332358 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.332508 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.332694 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.332823 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.333002 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.333142 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.333307 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.333436 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.333615 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.333742 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.333927 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.334058 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.334311 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.334442 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.334637 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.334780 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.334949 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.335078 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.335259 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.335390 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.335568 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.335701 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.335869 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.335997 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.336180 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.336436 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.336597 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.336797 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.337080 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.337210 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.337414 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.337544 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.337732 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.337869 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.338049 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.338177 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.338372 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.338512 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.338702 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.338829 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.339013 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.339155 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.339319 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.339449 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.339630 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.339760 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.339934 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.340073 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.340236 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.340374 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.340565 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.340713 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.340873 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.341014 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.341179 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.341484 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.341612 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.341790 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.341920 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.342091 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.342232 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.342397 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.342527 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.342699 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.342828 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.343001 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.343130 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.343304 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.343434 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.343607 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.343737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.343919 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.344048 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.344219 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.344347 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.344556 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.344690 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.344863 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.345001 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.345164 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.345305 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.345469 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.345610 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.345772 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.345902 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.346073 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.346213 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.346376 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.346505 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.346719 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.346857 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.347026 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.347168 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.347366 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.347496 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.347668 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.347796 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.347973 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.348112 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.348297 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.348426 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.348629 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.348769 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.348955 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.349086 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.349266 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.349406 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.349568 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.350238 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.350381 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.350508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.350690 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.350821 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.351086 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.351214 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.351399 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.351529 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.351710 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.351838 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.352022 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.352155 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.352326 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.352454 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.352659 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.352788 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.352963 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.353101 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.353272 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.353400 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.353577 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.353714 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.353877 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.354015 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.354180 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.354310 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.354487 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.354618 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.354789 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.354927 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.355087 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.355214 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.355396 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.355525 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.355698 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.355840 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.356013 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.356151 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.356316 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.356454 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.356684 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.356814 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.356940 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.357065 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.357228 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.357367 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.357536 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.357667 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.357838 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.357981 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.358145 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.358280 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.358451 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.358581 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.358752 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.358880 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.359054 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.359185 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.359363 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.359485 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.359665 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.359800 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.359967 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.360105 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.360268 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.360395 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.360623 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.360763 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.360940 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.361083 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.361242 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.361371 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.361551 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.361681 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.361858 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.361995 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.362159 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.362286 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.362459 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.362586 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.362764 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.362900 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.363064 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.363198 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.363363 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.363491 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.363659 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.363788 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.363958 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.364094 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.364257 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.364385 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.364568 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.364707 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.364872 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.365001 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.365187 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.365400 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.365542 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.365677 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.365838 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.366000 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.366308 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.366435 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.366612 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.366742 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.366956 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.367085 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.367259 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.367397 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.367573 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.367709 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.367892 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.368029 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.368204 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.368341 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.368538 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.368670 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.368853 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.368984 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.369153 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.369298 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.369470 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.369600 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.369771 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.369905 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.370081 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.370222 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.370385 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.370515 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.370687 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.370809 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.370987 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.371133 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.371289 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.371419 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.371601 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.371730 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.371908 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.372038 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.372217 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.372347 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.372562 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.372694 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.372868 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.373005 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.373176 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.373306 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.373481 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.373619 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.373789 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.373917 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.374097 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.374225 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.374393 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.374519 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.374698 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.374829 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.375004 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.375139 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.375310 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.375448 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.375618 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.375758 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.375925 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.376061 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.376227 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.376366 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.376554 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.376697 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.376858 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.376989 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.377158 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.377296 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.377462 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.377599 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.377765 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.377894 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.378064 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.378201 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.378372 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.378509 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.378671 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.378799 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.378975 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.379104 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.379278 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.379409 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.379584 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.379712 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.379886 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.380016 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.380283 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.380421 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.380594 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.380736 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.380905 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.381607 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.381741 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.381865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.382038 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.382183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.382348 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.382483 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.382665 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.382806 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.382980 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.383145 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.383283 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.383457 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.383683 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.383813 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.383996 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.384139 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.384308 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.384439 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.384643 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.384776 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.384948 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.385087 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.385251 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.385381 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.385558 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.385687 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.385861 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.386069 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.386195 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.386328 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.386454 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.386585 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.386750 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.386880 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.387067 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.387196 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.387370 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.387497 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.387690 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.387821 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.388063 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.388190 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.388401 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.388590 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.388732 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.388868 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.389090 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.389218 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.389411 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.389549 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.389732 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.389886 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.390053 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.390182 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.390355 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.390484 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.390670 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.390799 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.390976 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.391111 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.391294 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.391424 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.391605 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.391744 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.391914 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.392043 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.392234 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.392361 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.392558 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.392701 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.392874 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.393003 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.393177 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.393315 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.393491 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.393627 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.393810 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.393938 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.394125 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.394254 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.394446 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.394590 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.394821 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.394951 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.395139 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.395268 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.395461 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.395590 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.395763 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.395891 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.396065 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.396209 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.396399 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.396556 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.396909 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.397041 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.397167 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.397364 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.397508 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.397667 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.397797 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.397978 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.398115 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.398288 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.398428 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.398599 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.398729 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.398902 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.399031 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.399208 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.399340 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.399527 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.399658 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.399832 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.399969 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.400135 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.400272 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.400453 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.400609 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.400783 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.400912 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.401108 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.401238 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.401411 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.401542 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.401731 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.401860 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.402036 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.402165 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.402344 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.402476 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.402647 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.402785 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.402948 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.403079 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.403250 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.403380 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.403556 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.403694 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.403861 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.403993 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.404194 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.404323 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.404536 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.404681 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.404843 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.404978 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.405173 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.405304 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.405497 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.405626 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.405806 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.405941 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.406121 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.406257 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.406447 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.406578 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.406751 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.406881 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.407056 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.407187 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.407365 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.407502 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.407668 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.407805 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.407967 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.408096 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.408269 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.408398 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.408592 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.408721 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.408895 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.409033 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.409198 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.409326 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.409497 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.409626 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.409803 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.409940 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.410108 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.410231 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.410409 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.410537 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.410723 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.410861 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.411024 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.411159 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.411328 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.411465 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.411630 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.411768 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.411933 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.412068 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.412792 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.412928 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.413136 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.413306 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.413480 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.413610 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.413744 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.413871 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.414064 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.414203 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.414378 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.414509 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.414694 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.414825 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.415011 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.415134 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.415326 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.415457 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.415641 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.415772 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.415955 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.416088 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.416264 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.416394 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.416599 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.416737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.416915 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.417046 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.417229 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.417359 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.417635 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.417777 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.417959 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.418090 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.418278 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.418408 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.418668 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.418805 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.418983 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.419113 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.419298 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.419428 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.419612 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.419755 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.419926 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.420050 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.420240 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.420371 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.420641 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.420785 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.420953 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.421082 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.421268 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.421398 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.421580 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.421718 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.421892 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.422023 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.422222 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.422353 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.422544 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.422673 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.422861 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.422991 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.423177 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.423320 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.423495 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.423632 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.423808 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.423937 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.424125 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.424264 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.424441 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.424602 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.424782 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.424911 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.425099 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.425224 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.425413 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.425543 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.425721 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.425859 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.426067 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.426201 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.426328 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.426453 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.426677 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.426817 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.426954 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.427080 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.427229 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.427359 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.427540 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.427679 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.427908 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.428584 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.428777 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.428910 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.429079 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.429225 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.429401 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.429531 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.429717 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.429847 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.430030 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.430161 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.430346 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.430484 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.430696 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.430860 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.431000 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.431171 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.431309 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.431502 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.431819 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.431951 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.432136 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.432267 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.432445 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.432612 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.432789 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.432898 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.433116 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.433205 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.433419 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.433520 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.433722 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.433818 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.434032 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.434119 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.434341 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.434427 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.434644 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.434738 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.434957 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.435044 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.435269 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.435410 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.435572 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.435711 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.435887 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.436026 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.436193 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.436323 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.436536 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.436786 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.436929 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.437071 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.437199 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.437388 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.437651 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.437783 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.437998 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.438131 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.438317 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.438455 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.438620 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.438750 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.438944 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.439074 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.439250 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.439379 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.439553 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.439684 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.439866 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.440003 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.440172 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.440313 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.440473 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.440620 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.440797 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.440929 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.441107 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.441245 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.441411 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.441540 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.441713 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.441841 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.442019 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.442156 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.442323 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.442461 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.442626 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.442754 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.442937 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.443076 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.443238 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.443374 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.443585 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.443715 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.443893 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.444033 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.444193 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.444322 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.444528 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.444660 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.445079 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.445220 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.445381 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.445509 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.445684 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.445822 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.445985 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.446113 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.446283 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.446414 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.446583 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.446718 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.446866 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.446999 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.447179 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.447309 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.447484 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.447613 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.447792 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.447920 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.448094 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.448223 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.448403 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.448567 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.448742 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.448870 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.449059 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.449188 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.449372 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.449509 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.449674 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.449802 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.449990 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.450118 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.450295 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.450430 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.450616 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.450744 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.450929 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.451065 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.451240 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.451459 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.451596 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.451794 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.451931 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.452111 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.452411 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.452560 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.452781 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.452913 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.453086 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.453215 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.453393 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.453524 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.453697 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.453829 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.454020 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.454151 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.454325 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.454463 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.454629 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.454760 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.454935 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.455071 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.455247 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.455378 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.455556 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.455685 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.455865 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.456072 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.456202 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.456326 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.456452 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.456601 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.456786 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.456919 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.457095 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.457226 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.457403 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.457533 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.457712 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.457851 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.458019 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.458157 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.458325 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.458455 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.458639 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.458779 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.458947 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.459111 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.459314 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.459445 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.459631 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.459762 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.459948 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.460086 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.460262 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.460393 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.460604 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.460736 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.460914 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.461052 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.461221 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.461363 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.461528 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.461664 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.461842 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.461971 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.462172 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.462313 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.462488 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.462623 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.462790 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.462927 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.463121 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.463264 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.463435 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.463565 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.463741 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.463872 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.464106 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.464236 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.464415 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.464577 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.464763 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.464893 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.465084 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.465216 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.465394 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.465524 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.465714 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.465843 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.466021 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.466150 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.466335 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.466465 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.466657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.466796 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.466971 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.467109 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.467302 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.467438 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.467607 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.467745 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.467911 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.468048 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.468214 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.468344 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.468553 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.468700 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.468873 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.469003 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.469180 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.469311 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.469481 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.469624 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.469784 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.469915 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.470091 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.470222 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.470392 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.470523 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.470695 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.470823 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.470994 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.471130 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.471295 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.471432 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.471599 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.471728 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.471901 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.472031 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.472201 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.472338 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.472539 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.472674 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.472812 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.472940 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.473117 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.473249 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.473417 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.473547 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.473719 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.473856 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.474018 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.474147 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.474318 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.474447 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.474616 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.475287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.475427 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.475543 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.475725 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.475905 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.476056 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.476220 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.476390 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.476542 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.476732 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.476862 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.477055 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.477239 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.477375 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.477502 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.477675 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.477805 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.477986 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.478124 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.478308 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.478438 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.478630 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.478760 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.478946 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.479077 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.479256 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.479386 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.479586 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.479723 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.479898 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.480030 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.480210 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.480353 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.480541 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.480688 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.480855 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.480998 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.481167 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.481297 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.481478 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.481620 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.481793 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.481924 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.482109 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.482240 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.482416 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.482554 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.482742 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.482872 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.483064 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.483203 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.483370 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.483508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.483690 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.483818 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.484002 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.484133 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.484323 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.484451 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.484657 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.484794 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.484957 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.485087 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.485288 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.485417 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.485551 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.485668 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.485860 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.485990 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.486175 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.486306 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.486485 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.486613 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.486795 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.486942 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.487111 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.487231 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.487424 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.487555 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.487738 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.487882 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.488058 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.488189 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.488366 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.488537 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.488718 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.488857 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.489045 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.489180 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.489355 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.489485 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.489682 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.489813 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.490011 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.490148 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.490376 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.491004 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.491184 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.491499 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.491645 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.491773 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.491898 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.492024 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 11:34:33.492160 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.492440 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.492779 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.493088 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:34:33.493331 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 11:34:33.645449 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO dbcounter [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] Registered counter for database nova_api Aug 31 11:34:33.646651 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO dbcounter [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Registered counter for database nova_api Aug 31 11:34:33.667897 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG oslo_db.sqlalchemy.engines [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:34:33.669494 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_db.sqlalchemy.engines [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:34:33.675192 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG dbcounter [-] [112044] Writer thread running {{(pid=112044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:34:33.676076 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG dbcounter [-] [112043] Writer thread running {{(pid=112043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:34:33.733682 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.context [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e384889-6636-4480-9f30-0e4cdfea2d8c(cell1) {{(pid=112044) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 11:34:33.734037 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.context [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e384889-6636-4480-9f30-0e4cdfea2d8c(cell1) {{(pid=112043) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 11:34:33.737450 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG oslo_concurrency.lockutils [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:34:33.737878 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:34:33.738007 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG oslo_concurrency.lockutils [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:34:33.738345 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:34:33.739463 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG oslo_concurrency.lockutils [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:34:33.739890 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:34:33.740185 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG oslo_concurrency.lockutils [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:34:33.740762 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG oslo_concurrency.lockutils [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:34:33.741263 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:34:33.741263 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:34:33.742668 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG oslo_concurrency.lockutils [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:34:33.743178 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:34:33.744634 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO dbcounter [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] Registered counter for database nova_cell0 Aug 31 11:34:33.745132 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO dbcounter [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Registered counter for database nova_cell0 Aug 31 11:34:33.748656 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO dbcounter [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] Registered counter for database nova_cell1 Aug 31 11:34:33.749099 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO dbcounter [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Registered counter for database nova_cell1 Aug 31 11:34:33.755681 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG oslo_db.sqlalchemy.engines [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:34:33.759065 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_db.sqlalchemy.engines [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:34:33.759486 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG oslo_db.sqlalchemy.engines [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:34:33.762337 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_db.sqlalchemy.engines [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:34:33.762593 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG dbcounter [-] [112044] Writer thread running {{(pid=112044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:34:33.765672 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG dbcounter [-] [112043] Writer thread running {{(pid=112043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:34:33.901793 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG dbcounter [-] [112044] Writer thread running {{(pid=112044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:34:33.906694 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG dbcounter [-] [112043] Writer thread running {{(pid=112043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:34:33.910591 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO dbcounter [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] Registered counter for database nova_cell0 Aug 31 11:34:33.917214 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO dbcounter [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Registered counter for database nova_cell0 Aug 31 11:34:33.919885 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG oslo_db.sqlalchemy.engines [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:34:33.924655 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG dbcounter [-] [112044] Writer thread running {{(pid=112044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:34:33.925716 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_db.sqlalchemy.engines [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:34:33.930447 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG dbcounter [-] [112043] Writer thread running {{(pid=112043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:34:34.266775 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: WARNING keystonemiddleware.auth_token [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 11:34:34.274207 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: WARNING keystonemiddleware.auth_token [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 11:34:34.277391 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: WARNING keystonemiddleware.auth_token [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 11:34:34.285428 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: WARNING keystonemiddleware.auth_token [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 11:34:34.619761 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: WARNING keystonemiddleware.auth_token [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 11:34:34.625752 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: WARNING keystonemiddleware.auth_token [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 11:34:34.631058 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557818d329c0 pid: 112043 (default app) Aug 31 11:34:34.633165 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:34:34.634328 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001762 Aug 31 11:34:34.634735 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Wed Aug 31 11:34:34 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:34:34.643148 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: WARNING keystonemiddleware.auth_token [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 11:34:34.650221 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: WARNING keystonemiddleware.auth_token [None req-a6045c67-dafc-45b6-868b-312256b9b832 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 11:34:34.655501 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557818d329c0 pid: 112044 (default app) Aug 31 11:35:53.690179 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:35:53.691198 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 31 11:35:53.691603 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 31 11:35:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:35:53.705192 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG dbcounter [-] [112044] Writing DB stats nova_api:SELECT=3 {{(pid=112044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:53.706310 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG dbcounter [-] [112044] Writing DB stats nova_cell1:SELECT=3 {{(pid=112044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:53.707324 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG dbcounter [-] [112044] Writing DB stats nova_cell0:SELECT=3 {{(pid=112044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:53.709733 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG dbcounter [-] [112044] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:54.611638 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-87bb87f1-0722-4f1f-835d-31e103ce1e13 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:35:54.646465 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-87bb87f1-0722-4f1f-835d-31e103ce1e13 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.946386 Aug 31 11:35:54.647521 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Aug 31 11:35:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:35:57.018650 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:35:57.019489 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-fd0e1199-0f86-45f9-b993-49f10ec6b547 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001378 Aug 31 11:35:57.025234 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 31 11:35:57 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:35:57.465608 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-b3b6d7bd-1147-4c06-9f9b-30884567c5c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "ram": 256}} {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:35:57.513197 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-b3b6d7bd-1147-4c06-9f9b-30884567c5c2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.486721 Aug 31 11:35:57.513774 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 31 11:35:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:35:57.739655 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-8190c12f-e4ee-4b70-854a-ea3187489eaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:35:57.761808 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG dbcounter [-] [112043] Writing DB stats nova_api:SELECT=3 {{(pid=112043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:57.762711 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG dbcounter [-] [112043] Writing DB stats nova_cell0:SELECT=3 {{(pid=112043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:57.763457 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG dbcounter [-] [112043] Writing DB stats nova_cell1:SELECT=3 {{(pid=112043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:57.764222 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG dbcounter [-] [112043] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:35:57.803874 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-8190c12f-e4ee-4b70-854a-ea3187489eaf admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280877 Aug 31 11:35:57.804824 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Aug 31 11:35:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:36:00.166505 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-b3b6d7bd-1147-4c06-9f9b-30884567c5c2 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:00.167527 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-b3b6d7bd-1147-4c06-9f9b-30884567c5c2 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 31 11:36:00.168114 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 31 11:36:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:00.838885 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-2468b920-ab72-411f-a376-2a7207e81f10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:00.882667 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-2468b920-ab72-411f-a376-2a7207e81f10 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.707680 Aug 31 11:36:00.883355 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 31 11:36:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:36:00.895126 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-5969ab9e-fc22-49fa-a2df-982059762522 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:00.932044 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-5969ab9e-fc22-49fa-a2df-982059762522 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040499 Aug 31 11:36:00.932659 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Aug 31 11:36:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:36:03.303603 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-2468b920-ab72-411f-a376-2a7207e81f10 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:03.304780 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-2468b920-ab72-411f-a376-2a7207e81f10 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Aug 31 11:36:03.305285 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 31 11:36:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:03.665109 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-19a515ae-b553-4d4d-ac82-ba24e1266632 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "disk": 10, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:03.686208 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-19a515ae-b553-4d4d-ac82-ba24e1266632 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.374917 Aug 31 11:36:03.686931 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 31 11:36:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:36:03.699149 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-0e02b6bd-60d4-4082-b0d2-ea9b6684a2c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:03.724817 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-0e02b6bd-60d4-4082-b0d2-ea9b6684a2c0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029583 Aug 31 11:36:03.725491 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Aug 31 11:36:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:36:06.097617 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-19a515ae-b553-4d4d-ac82-ba24e1266632 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:06.098590 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-19a515ae-b553-4d4d-ac82-ba24e1266632 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 31 11:36:06.098998 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 31 11:36:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:06.533491 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-bc8fd0f4-1021-4b33-90ee-6800970a5d58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds2G", "ram": 2048, "id": "d3", "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:06.565772 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-bc8fd0f4-1021-4b33-90ee-6800970a5d58 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.460768 Aug 31 11:36:06.566733 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 31 11:36:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:36:06.582191 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-223defcb-e26c-48e4-bf74-03106b097465 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:06.615671 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-223defcb-e26c-48e4-bf74-03106b097465 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037927 Aug 31 11:36:06.617083 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Aug 31 11:36:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:36:09.020411 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-bc8fd0f4-1021-4b33-90ee-6800970a5d58 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:09.021473 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-bc8fd0f4-1021-4b33-90ee-6800970a5d58 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Aug 31 11:36:09.021870 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 31 11:36:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:09.484625 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-10ac31ab-3995-4783-ad71-523d4fcf1e96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4}} {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:09.505380 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-10ac31ab-3995-4783-ad71-523d4fcf1e96 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476458 Aug 31 11:36:09.506449 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 31 11:36:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 11:36:09.518646 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-30772d44-e58a-417a-9b71-6acdb3312f7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:09.544157 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-30772d44-e58a-417a-9b71-6acdb3312f7e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029490 Aug 31 11:36:09.548521 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1336 bytes} [Wed Aug 31 11:36:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:36:11.901945 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-10ac31ab-3995-4783-ad71-523d4fcf1e96 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:11.902959 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-10ac31ab-3995-4783-ad71-523d4fcf1e96 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 31 11:36:11.903394 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 31 11:36:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:12.359273 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-655568f7-44ed-4f89-bc52-7ef6c91c8c4a admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:12.383596 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-655568f7-44ed-4f89-bc52-7ef6c91c8c4a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.474006 Aug 31 11:36:12.384135 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Aug 31 11:36:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:36:14.912331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-10ac31ab-3995-4783-ad71-523d4fcf1e96 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:14.913452 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-10ac31ab-3995-4783-ad71-523d4fcf1e96 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Aug 31 11:36:14.913806 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 31 11:36:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:15.346174 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-ca2f9246-6d93-473f-8569-104830d0f359 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "swap": 0, "rxtx_factor": 1.0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1}} {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:15.369540 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-ca2f9246-6d93-473f-8569-104830d0f359 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.449466 Aug 31 11:36:15.370227 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 31 11:36:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 11:36:15.384003 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-023a800d-c2e0-498d-bad8-4c91e57e92bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:15.409346 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-023a800d-c2e0-498d-bad8-4c91e57e92bf admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030488 Aug 31 11:36:15.409931 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Aug 31 11:36:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:36:17.899474 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-ca2f9246-6d93-473f-8569-104830d0f359 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:17.900471 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-ca2f9246-6d93-473f-8569-104830d0f359 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 31 11:36:17.900897 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 31 11:36:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:18.306822 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-a95b83be-f596-4f81-b847-dcd9f01b17ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1, "id": "2"}} {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:18.327370 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-a95b83be-f596-4f81-b847-dcd9f01b17ab admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.420380 Aug 31 11:36:18.328280 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 31 11:36:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:36:18.339916 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-376838c2-76a2-401f-8a8a-bb939b91da73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:18.363308 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-376838c2-76a2-401f-8a8a-bb939b91da73 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027025 Aug 31 11:36:18.365081 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Aug 31 11:36:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:36:20.747056 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-a95b83be-f596-4f81-b847-dcd9f01b17ab admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:20.747999 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-a95b83be-f596-4f81-b847-dcd9f01b17ab admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 31 11:36:20.748405 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 31 11:36:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:21.162415 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-7574c424-fdb2-40aa-89a9-6a1261ea409e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "vcpus": 2, "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:21.183758 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-7574c424-fdb2-40aa-89a9-6a1261ea409e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.429068 Aug 31 11:36:21.184605 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 31 11:36:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:36:21.197667 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-f44ae84e-0638-4b7c-aded-e5092b7e231c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:21.224542 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-f44ae84e-0638-4b7c-aded-e5092b7e231c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030705 Aug 31 11:36:21.225133 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Aug 31 11:36:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:36:23.594149 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-7574c424-fdb2-40aa-89a9-6a1261ea409e admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:23.595156 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-7574c424-fdb2-40aa-89a9-6a1261ea409e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 31 11:36:23.595551 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 31 11:36:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:24.060739 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-58cc0d44-7444-4a32-8a4e-bdbd3c45badc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "name": "m1.large", "disk": 80, "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:24.066396 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG dbcounter [-] [112044] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:24.084038 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-58cc0d44-7444-4a32-8a4e-bdbd3c45badc admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.481728 Aug 31 11:36:24.084966 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 31 11:36:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:36:24.096858 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-dbc2f0a3-5d34-43c3-b75d-84c852e079e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:24.123782 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-dbc2f0a3-5d34-43c3-b75d-84c852e079e9 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030626 Aug 31 11:36:24.124371 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Aug 31 11:36:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:36:26.623516 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-58cc0d44-7444-4a32-8a4e-bdbd3c45badc admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:26.625226 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-58cc0d44-7444-4a32-8a4e-bdbd3c45badc admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 Aug 31 11:36:26.625839 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 31 11:36:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:27.073123 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-71efc4a8-a7ec-43aa-a122-8142901e8825 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "disk": 160, "swap": 0, "name": "m1.xlarge"}} {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:27.092563 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-71efc4a8-a7ec-43aa-a122-8142901e8825 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.459590 Aug 31 11:36:27.093109 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1283 bytes} [Wed Aug 31 11:36:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:36:27.105207 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-4e1509a3-1699-4b92-afd5-85e27060c3ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:27.131898 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-4e1509a3-1699-4b92-afd5-85e27060c3ee admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030115 Aug 31 11:36:27.132515 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1333 bytes} [Wed Aug 31 11:36:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:36:46.162211 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-71efc4a8-a7ec-43aa-a122-8142901e8825 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:46.163257 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-71efc4a8-a7ec-43aa-a122-8142901e8825 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 31 11:36:46.163691 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 31 11:36:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:46.174328 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG dbcounter [-] [112044] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:46.560011 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-7f05ff04-68a6-4088-b0d3-ca3ca5a38c6c admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:46.579828 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-7f05ff04-68a6-4088-b0d3-ca3ca5a38c6c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409840 Aug 31 11:36:46.580302 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Aug 31 11:36:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:36:47.632154 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-71efc4a8-a7ec-43aa-a122-8142901e8825 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:47.633244 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-71efc4a8-a7ec-43aa-a122-8142901e8825 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 31 11:36:47.633635 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 31 11:36:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:48.157444 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-3dfaf2e4-0f81-4103-9a8d-3608bb70638f admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:48.163571 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.wsgi [None req-3dfaf2e4-0f81-4103-9a8d-3608bb70638f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-3dfaf2e4-0f81-4103-9a8d-3608bb70638f admin admin] Request method failure captured: Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Accept: application/json Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Accept-Encoding: gzip, deflate Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Connection: keep-alive Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Content-Length: 0 Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Host: 10.222.0.60 Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Openstack-Api-Version: compute 2.90 Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Openstack-System-Scope: None Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: User-Agent: python-novaclient Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Auth-Token: gAAAAABjD0fPH7SgRtYaVYHtWagerWhFHqMg8AAgNhqbAMHZlRelJKvfcJ9O-vlG4QJfGZOvaG20NaDk0sd6W4Rap7EZAbcMaOOPGxpkXrXS75IUujTzljKtzgX9U1lWJurE_97gwZu0VpM7S4plImlCqGBvbfPYEqM6LYbeBBK64X6GmDbCKDo Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Domain-Id: None Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Domain-Name: None Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Identity-Status: Confirmed Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Is-Admin-Project: True Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Project-Domain-Id: default Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Project-Domain-Name: Default Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Project-Id: 927949f45e9a418783820746376979d1 Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Project-Name: admin Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Role: reader,admin,member Aug 31 11:36:48.166810 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Roles: reader,admin,member Aug 31 11:36:48.168430 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_927949f45e9a418783820746376979d1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/927949f45e9a418783820746376979d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/927949f45e9a418783820746376979d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/927949f45e9a418783820746376979d1"}]}] Aug 31 11:36:48.168430 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Tenant: admin Aug 31 11:36:48.168430 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Tenant-Id: 927949f45e9a418783820746376979d1 Aug 31 11:36:48.168430 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Tenant-Name: admin Aug 31 11:36:48.168430 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-User: admin Aug 31 11:36:48.168430 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-User-Domain-Id: default Aug 31 11:36:48.168430 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-User-Domain-Name: Default Aug 31 11:36:48.168430 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-User-Id: 824ec611f32e40609c56e94f7edd552e Aug 31 11:36:48.168430 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-User-Name: admin Aug 31 11:36:48.168430 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: method: > Aug 31 11:36:48.168430 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: exception: Flavor 42 could not be found. Aug 31 11:36:48.168430 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: action_args: {'id': '42'} Aug 31 11:36:48.168430 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:36:48.168430 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:36:48.169508 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Aug 31 11:36:48.170876 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-3dfaf2e4-0f81-4103-9a8d-3608bb70638f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:36:48.172134 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-3dfaf2e4-0f81-4103-9a8d-3608bb70638f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.398444 Aug 31 11:36:48.172134 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Aug 31 11:36:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:48.177820 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-7e8eb4c9-d846-4b3f-b8f2-1c6fb4651464 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:48.181891 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG dbcounter [-] [112043] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:36:48.202935 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-7e8eb4c9-d846-4b3f-b8f2-1c6fb4651464 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028601 Aug 31 11:36:48.203479 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 31 11:36:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:36:48.213807 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-f1b53f84-b566-4ac5-9752-b44a3ba72dba admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:48.236997 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-f1b53f84-b566-4ac5-9752-b44a3ba72dba admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026715 Aug 31 11:36:48.237648 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 31 11:36:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:36:48.247619 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-bd9575ef-6464-4656-bcf7-03d2428d7040 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:48.254025 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.wsgi [None req-bd9575ef-6464-4656-bcf7-03d2428d7040 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-bd9575ef-6464-4656-bcf7-03d2428d7040 admin admin] Request method failure captured: Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Accept: application/json Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Accept-Encoding: gzip, deflate Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Connection: keep-alive Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Content-Length: 0 Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Host: 10.222.0.60 Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Openstack-Api-Version: compute 2.90 Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Openstack-System-Scope: None Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: User-Agent: python-novaclient Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Auth-Token: gAAAAABjD0fPH7SgRtYaVYHtWagerWhFHqMg8AAgNhqbAMHZlRelJKvfcJ9O-vlG4QJfGZOvaG20NaDk0sd6W4Rap7EZAbcMaOOPGxpkXrXS75IUujTzljKtzgX9U1lWJurE_97gwZu0VpM7S4plImlCqGBvbfPYEqM6LYbeBBK64X6GmDbCKDo Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Domain-Id: None Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Domain-Name: None Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Identity-Status: Confirmed Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Is-Admin-Project: True Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Project-Domain-Id: default Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Project-Domain-Name: Default Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Project-Id: 927949f45e9a418783820746376979d1 Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Project-Name: admin Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Role: reader,admin,member Aug 31 11:36:48.257287 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Roles: reader,admin,member Aug 31 11:36:48.258868 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_927949f45e9a418783820746376979d1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/927949f45e9a418783820746376979d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/927949f45e9a418783820746376979d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/927949f45e9a418783820746376979d1"}]}] Aug 31 11:36:48.258868 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Tenant: admin Aug 31 11:36:48.258868 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Tenant-Id: 927949f45e9a418783820746376979d1 Aug 31 11:36:48.258868 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Tenant-Name: admin Aug 31 11:36:48.258868 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-User: admin Aug 31 11:36:48.258868 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-User-Domain-Id: default Aug 31 11:36:48.258868 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-User-Domain-Name: Default Aug 31 11:36:48.258868 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-User-Id: 824ec611f32e40609c56e94f7edd552e Aug 31 11:36:48.258868 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-User-Name: admin Aug 31 11:36:48.258868 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: method: > Aug 31 11:36:48.258868 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: exception: Flavor 42 could not be found. Aug 31 11:36:48.258868 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: action_args: {'id': '42'} Aug 31 11:36:48.258868 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:36:48.258868 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:36:48.259973 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Aug 31 11:36:48.261290 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-bd9575ef-6464-4656-bcf7-03d2428d7040 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:36:48.262621 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-bd9575ef-6464-4656-bcf7-03d2428d7040 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014875 Aug 31 11:36:48.262621 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Aug 31 11:36:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 11:36:49.249487 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-f1b53f84-b566-4ac5-9752-b44a3ba72dba admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:49.250488 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-f1b53f84-b566-4ac5-9752-b44a3ba72dba admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 31 11:36:49.250885 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 31 11:36:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:49.786872 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-ae5f238f-b02d-4176-a5f0-0f55a2da2e8e admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:49.792742 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.wsgi [None req-ae5f238f-b02d-4176-a5f0-0f55a2da2e8e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-ae5f238f-b02d-4176-a5f0-0f55a2da2e8e admin admin] Request method failure captured: Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Accept: application/json Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Accept-Encoding: gzip, deflate Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Connection: keep-alive Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Content-Length: 0 Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Host: 10.222.0.60 Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Openstack-Api-Version: compute 2.90 Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Openstack-System-Scope: None Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: User-Agent: python-novaclient Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Auth-Token: gAAAAABjD0fR1KtGWmAVQkAuk9OHKjMjjsJnY871aULUEoPfy-ih2EBLqgov6tVETMay2RexIMeDWGlt_oGklwtiTPh6Ay-JpNjw0RYgdmFG1XpEVoApyHts2zNIuOr-DYP0m-4_TggjZbuhZLbJaBaBrYOQMx-I9vJqQ73a4Ik9H7nSa9ZSTLc Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Domain-Id: None Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Domain-Name: None Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Identity-Status: Confirmed Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Is-Admin-Project: True Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Project-Domain-Id: default Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Project-Domain-Name: Default Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Project-Id: 927949f45e9a418783820746376979d1 Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Project-Name: admin Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Role: reader,admin,member Aug 31 11:36:49.794228 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Roles: reader,admin,member Aug 31 11:36:49.795737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_927949f45e9a418783820746376979d1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/927949f45e9a418783820746376979d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/927949f45e9a418783820746376979d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/927949f45e9a418783820746376979d1"}]}] Aug 31 11:36:49.795737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Tenant: admin Aug 31 11:36:49.795737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Tenant-Id: 927949f45e9a418783820746376979d1 Aug 31 11:36:49.795737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Tenant-Name: admin Aug 31 11:36:49.795737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-User: admin Aug 31 11:36:49.795737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-User-Domain-Id: default Aug 31 11:36:49.795737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-User-Domain-Name: Default Aug 31 11:36:49.795737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-User-Id: 824ec611f32e40609c56e94f7edd552e Aug 31 11:36:49.795737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-User-Name: admin Aug 31 11:36:49.795737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: method: > Aug 31 11:36:49.795737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: exception: Flavor 84 could not be found. Aug 31 11:36:49.795737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: action_args: {'id': '84'} Aug 31 11:36:49.795737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:36:49.795737 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:36:49.796657 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Aug 31 11:36:49.797721 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-ae5f238f-b02d-4176-a5f0-0f55a2da2e8e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:36:49.798743 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-ae5f238f-b02d-4176-a5f0-0f55a2da2e8e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.399090 Aug 31 11:36:49.798743 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Aug 31 11:36:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:49.805183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-b9db02fc-ee88-4167-a12b-edea06a6727f admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:49.820615 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-b9db02fc-ee88-4167-a12b-edea06a6727f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018989 Aug 31 11:36:49.821401 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 31 11:36:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:36:49.830614 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-d6f4deef-fdf6-4f76-bf2c-7af329d50a19 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:49.845896 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-d6f4deef-fdf6-4f76-bf2c-7af329d50a19 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018755 Aug 31 11:36:49.846434 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 31 11:36:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:36:49.855671 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-5e8ca148-acf9-434a-957d-48741f46121c admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:49.861295 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.wsgi [None req-5e8ca148-acf9-434a-957d-48741f46121c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-5e8ca148-acf9-434a-957d-48741f46121c admin admin] Request method failure captured: Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Accept: application/json Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Accept-Encoding: gzip, deflate Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Connection: keep-alive Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Content-Length: 0 Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Host: 10.222.0.60 Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Openstack-Api-Version: compute 2.90 Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Openstack-System-Scope: None Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: User-Agent: python-novaclient Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Auth-Token: gAAAAABjD0fR1KtGWmAVQkAuk9OHKjMjjsJnY871aULUEoPfy-ih2EBLqgov6tVETMay2RexIMeDWGlt_oGklwtiTPh6Ay-JpNjw0RYgdmFG1XpEVoApyHts2zNIuOr-DYP0m-4_TggjZbuhZLbJaBaBrYOQMx-I9vJqQ73a4Ik9H7nSa9ZSTLc Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Domain-Id: None Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Domain-Name: None Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Identity-Status: Confirmed Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Is-Admin-Project: True Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Project-Domain-Id: default Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Project-Domain-Name: Default Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Project-Id: 927949f45e9a418783820746376979d1 Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Project-Name: admin Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Role: reader,admin,member Aug 31 11:36:49.862865 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Roles: reader,admin,member Aug 31 11:36:49.864434 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_927949f45e9a418783820746376979d1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/927949f45e9a418783820746376979d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/927949f45e9a418783820746376979d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/927949f45e9a418783820746376979d1"}]}] Aug 31 11:36:49.864434 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Tenant: admin Aug 31 11:36:49.864434 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Tenant-Id: 927949f45e9a418783820746376979d1 Aug 31 11:36:49.864434 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Tenant-Name: admin Aug 31 11:36:49.864434 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-User: admin Aug 31 11:36:49.864434 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-User-Domain-Id: default Aug 31 11:36:49.864434 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-User-Domain-Name: Default Aug 31 11:36:49.864434 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-User-Id: 824ec611f32e40609c56e94f7edd552e Aug 31 11:36:49.864434 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-User-Name: admin Aug 31 11:36:49.864434 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: method: > Aug 31 11:36:49.864434 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: exception: Flavor 84 could not be found. Aug 31 11:36:49.864434 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: action_args: {'id': '84'} Aug 31 11:36:49.864434 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:36:49.864434 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:36:49.865525 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Aug 31 11:36:49.867137 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-5e8ca148-acf9-434a-957d-48741f46121c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:36:49.868401 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-5e8ca148-acf9-434a-957d-48741f46121c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012062 Aug 31 11:36:49.868401 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Aug 31 11:36:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:50.828814 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-d6f4deef-fdf6-4f76-bf2c-7af329d50a19 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:50.829815 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-d6f4deef-fdf6-4f76-bf2c-7af329d50a19 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 31 11:36:50.830203 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 31 11:36:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:51.352654 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-fa7fa951-7ee1-4132-8f9e-00969264a482 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:51.358359 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.wsgi [None req-fa7fa951-7ee1-4132-8f9e-00969264a482 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-fa7fa951-7ee1-4132-8f9e-00969264a482 admin admin] Request method failure captured: Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Accept: application/json Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Accept-Encoding: gzip, deflate Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Connection: keep-alive Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Content-Length: 0 Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Host: 10.222.0.60 Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Openstack-Api-Version: compute 2.90 Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Openstack-System-Scope: None Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: User-Agent: python-novaclient Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Auth-Token: gAAAAABjD0fSCJ9-OLPBIXmz6GraQjuGwW1_x3ouYU_YfU_qQFnBGjPa7KrMpcDCN9F_SO4Rwr8-z31UkFK-HdZ7qkKNBg8A_7w2WcEM3FMsWSAS5R68YQy4hCxacauH1_1pHMrfEB5zf5IJqL82MfEuAcJrhOrcvl-tMhV8RFzWgP3Tfwy-AJA Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Domain-Id: None Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Domain-Name: None Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Identity-Status: Confirmed Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Is-Admin-Project: True Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Project-Domain-Id: default Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Project-Domain-Name: Default Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Project-Id: 927949f45e9a418783820746376979d1 Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Project-Name: admin Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Role: reader,admin,member Aug 31 11:36:51.359853 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Roles: reader,admin,member Aug 31 11:36:51.361331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_927949f45e9a418783820746376979d1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/927949f45e9a418783820746376979d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/927949f45e9a418783820746376979d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/927949f45e9a418783820746376979d1"}]}] Aug 31 11:36:51.361331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Tenant: admin Aug 31 11:36:51.361331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Tenant-Id: 927949f45e9a418783820746376979d1 Aug 31 11:36:51.361331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-Tenant-Name: admin Aug 31 11:36:51.361331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-User: admin Aug 31 11:36:51.361331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-User-Domain-Id: default Aug 31 11:36:51.361331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-User-Domain-Name: Default Aug 31 11:36:51.361331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-User-Id: 824ec611f32e40609c56e94f7edd552e Aug 31 11:36:51.361331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: X-User-Name: admin Aug 31 11:36:51.361331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: method: > Aug 31 11:36:51.361331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: exception: Flavor 451 could not be found. Aug 31 11:36:51.361331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: action_args: {'id': '451'} Aug 31 11:36:51.361331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:36:51.361331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:36:51.362183 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: ERROR nova.api.openstack.wsgi Aug 31 11:36:51.364232 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-fa7fa951-7ee1-4132-8f9e-00969264a482 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:36:51.365566 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-fa7fa951-7ee1-4132-8f9e-00969264a482 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.393989 Aug 31 11:36:51.365566 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 31 11:36:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:51.371682 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-b86dae8e-58c3-4b33-b6c0-5f9b5794abc6 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:51.388457 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-b86dae8e-58c3-4b33-b6c0-5f9b5794abc6 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020411 Aug 31 11:36:51.389010 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 31 11:36:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:36:51.398485 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-9297391a-51a5-49ec-9ef2-21154bece733 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:51.414002 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-9297391a-51a5-49ec-9ef2-21154bece733 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019035 Aug 31 11:36:51.414532 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Aug 31 11:36:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:36:51.423358 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-f886d2d0-ff55-4e0c-83f1-fff9f3dd1829 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:51.429256 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.wsgi [None req-f886d2d0-ff55-4e0c-83f1-fff9f3dd1829 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-f886d2d0-ff55-4e0c-83f1-fff9f3dd1829 admin admin] Request method failure captured: Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Accept: application/json Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Accept-Encoding: gzip, deflate Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Connection: keep-alive Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Content-Length: 0 Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Host: 10.222.0.60 Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Openstack-Api-Version: compute 2.90 Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Openstack-System-Scope: None Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: User-Agent: python-novaclient Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Auth-Token: gAAAAABjD0fSCJ9-OLPBIXmz6GraQjuGwW1_x3ouYU_YfU_qQFnBGjPa7KrMpcDCN9F_SO4Rwr8-z31UkFK-HdZ7qkKNBg8A_7w2WcEM3FMsWSAS5R68YQy4hCxacauH1_1pHMrfEB5zf5IJqL82MfEuAcJrhOrcvl-tMhV8RFzWgP3Tfwy-AJA Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Domain-Id: None Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Domain-Name: None Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Identity-Status: Confirmed Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Is-Admin-Project: True Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Project-Domain-Id: default Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Project-Domain-Name: Default Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Project-Id: 927949f45e9a418783820746376979d1 Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Project-Name: admin Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Role: reader,admin,member Aug 31 11:36:51.430739 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Roles: reader,admin,member Aug 31 11:36:51.432299 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_927949f45e9a418783820746376979d1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/927949f45e9a418783820746376979d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/927949f45e9a418783820746376979d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/927949f45e9a418783820746376979d1"}]}] Aug 31 11:36:51.432299 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Tenant: admin Aug 31 11:36:51.432299 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Tenant-Id: 927949f45e9a418783820746376979d1 Aug 31 11:36:51.432299 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-Tenant-Name: admin Aug 31 11:36:51.432299 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-User: admin Aug 31 11:36:51.432299 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-User-Domain-Id: default Aug 31 11:36:51.432299 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-User-Domain-Name: Default Aug 31 11:36:51.432299 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-User-Id: 824ec611f32e40609c56e94f7edd552e Aug 31 11:36:51.432299 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: X-User-Name: admin Aug 31 11:36:51.432299 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: method: > Aug 31 11:36:51.432299 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: exception: Flavor 451 could not be found. Aug 31 11:36:51.432299 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: action_args: {'id': '451'} Aug 31 11:36:51.432299 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:36:51.432299 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:36:51.433271 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: ERROR nova.api.openstack.wsgi Aug 31 11:36:51.434302 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-f886d2d0-ff55-4e0c-83f1-fff9f3dd1829 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:36:51.435305 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-f886d2d0-ff55-4e0c-83f1-fff9f3dd1829 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012158 Aug 31 11:36:51.435305 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 31 11:36:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 11:36:52.432694 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-9297391a-51a5-49ec-9ef2-21154bece733 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:52.433690 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-9297391a-51a5-49ec-9ef2-21154bece733 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 31 11:36:52.434076 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 31 11:36:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:52.951510 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-59897e0a-81f3-4c55-8a21-46c6e1ba2067 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:52.970618 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-59897e0a-81f3-4c55-8a21-46c6e1ba2067 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.402025 Aug 31 11:36:52.971150 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Aug 31 11:36:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:36:53.951687 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-9297391a-51a5-49ec-9ef2-21154bece733 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:53.952813 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-9297391a-51a5-49ec-9ef2-21154bece733 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 31 11:36:53.953210 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 31 11:36:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:54.500224 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-ccf6c8be-fc20-4ceb-857a-a6ff17cee647 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:54.518348 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-ccf6c8be-fc20-4ceb-857a-a6ff17cee647 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.417190 Aug 31 11:36:54.519004 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Aug 31 11:36:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:36:55.500061 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-9297391a-51a5-49ec-9ef2-21154bece733 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:55.501092 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-9297391a-51a5-49ec-9ef2-21154bece733 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 31 11:36:55.501514 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 31 11:36:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:56.038167 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-9b25dd9b-6ef3-4b54-be5c-00415a3f63a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:56.057041 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-9b25dd9b-6ef3-4b54-be5c-00415a3f63a1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.408133 Aug 31 11:36:56.057585 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Aug 31 11:36:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:36:57.022541 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-9297391a-51a5-49ec-9ef2-21154bece733 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:57.023567 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-9297391a-51a5-49ec-9ef2-21154bece733 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 31 11:36:57.023958 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 31 11:36:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:57.546499 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-01ba25dd-5b4b-4cde-b48c-c7d538511257 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:36:57.566830 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-01ba25dd-5b4b-4cde-b48c-c7d538511257 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.407442 Aug 31 11:36:57.567320 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Aug 31 11:36:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:36:58.535046 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-9297391a-51a5-49ec-9ef2-21154bece733 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:58.536080 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-9297391a-51a5-49ec-9ef2-21154bece733 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 31 11:36:58.536483 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 31 11:36:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:36:59.054808 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-9fdf72c6-dc19-4379-9778-d49036d593a4 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:36:59.075136 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-9fdf72c6-dc19-4379-9778-d49036d593a4 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403324 Aug 31 11:36:59.075664 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Wed Aug 31 11:36:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:37:52.716336 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-9297391a-51a5-49ec-9ef2-21154bece733 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:37:52.717576 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-9297391a-51a5-49ec-9ef2-21154bece733 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Aug 31 11:37:52.718520 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 931 bytes} [Wed Aug 31 11:37:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:37:52.728944 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG dbcounter [-] [112043] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:53.118450 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-9279c02d-0b00-4acd-8d29-230bf494c1b8 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:37:53.139266 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-9279c02d-0b00-4acd-8d29-230bf494c1b8 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.414724 Aug 31 11:37:53.140464 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1292 bytes} [Wed Aug 31 11:37:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:37:53.165144 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG dbcounter [-] [112044] Writing DB stats nova_api:SELECT=14 {{(pid=112044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:37:53.168997 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-70d251fc-57de-4382-b1f1-958a85a8f986 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:37:53.177513 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-70d251fc-57de-4382-b1f1-958a85a8f986 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013772 Aug 31 11:37:53.178059 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1283 bytes} [Wed Aug 31 11:37:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:37:53.190049 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-8f176368-eb05-441a-9101-42593ebd3f10 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:37:53.198862 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-8f176368-eb05-441a-9101-42593ebd3f10 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012665 Aug 31 11:37:53.199383 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1286 bytes} [Wed Aug 31 11:37:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:37:53.211401 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-91d3f9db-7e51-40b5-a432-955008a4f469 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:37:53.219807 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-91d3f9db-7e51-40b5-a432-955008a4f469 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011913 Aug 31 11:37:53.220267 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1286 bytes} [Wed Aug 31 11:37:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:37:53.231620 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-674d832a-e36b-4d58-800c-aa0f4b2b1d63 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:37:53.239248 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-674d832a-e36b-4d58-800c-aa0f4b2b1d63 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011169 Aug 31 11:37:53.239759 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1283 bytes} [Wed Aug 31 11:37:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:40:54.872573 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-91d3f9db-7e51-40b5-a432-955008a4f469 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:40:54.873579 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-91d3f9db-7e51-40b5-a432-955008a4f469 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 31 11:40:54.873975 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 31 11:40:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:40:55.022634 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG dbcounter [-] [112043] Writing DB stats nova_api:SELECT=6 {{(pid=112043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:40:55.180159 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-458f9a60-7052-4dc0-860f-59825d6c072c admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:40:55.183668 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-458f9a60-7052-4dc0-860f-59825d6c072c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:40:55.184134 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-458f9a60-7052-4dc0-860f-59825d6c072c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:40:55.184574 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-458f9a60-7052-4dc0-860f-59825d6c072c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:40:55.185274 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-458f9a60-7052-4dc0-860f-59825d6c072c admin admin] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:40:55.185711 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-458f9a60-7052-4dc0-860f-59825d6c072c admin admin] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:40:55.186117 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-458f9a60-7052-4dc0-860f-59825d6c072c admin admin] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:40:55.220644 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-458f9a60-7052-4dc0-860f-59825d6c072c admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199548 Aug 31 11:40:55.221192 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 31 11:40:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:40:56.099332 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-91d3f9db-7e51-40b5-a432-955008a4f469 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:40:56.100331 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-91d3f9db-7e51-40b5-a432-955008a4f469 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Aug 31 11:40:56.100764 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 31 11:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:40:56.299368 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-84674b8e-6657-47ae-96f7-dc10d83977a7 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:40:56.303360 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-84674b8e-6657-47ae-96f7-dc10d83977a7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:40:56.303830 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-84674b8e-6657-47ae-96f7-dc10d83977a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:40:56.304249 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-84674b8e-6657-47ae-96f7-dc10d83977a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:40:56.305020 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-84674b8e-6657-47ae-96f7-dc10d83977a7 admin admin] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:40:56.305452 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-84674b8e-6657-47ae-96f7-dc10d83977a7 admin admin] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:40:56.305925 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-84674b8e-6657-47ae-96f7-dc10d83977a7 admin admin] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:40:56.326112 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-84674b8e-6657-47ae-96f7-dc10d83977a7 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083343 Aug 31 11:40:56.326669 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 31 11:40:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:41:07.549397 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-91d3f9db-7e51-40b5-a432-955008a4f469 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:41:07.550425 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-91d3f9db-7e51-40b5-a432-955008a4f469 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 31 11:41:07.550964 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 31 11:41:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:41:07.700473 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG dbcounter [-] [112043] Writing DB stats nova_cell0:SELECT=4 {{(pid=112043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:07.701218 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG dbcounter [-] [112043] Writing DB stats nova_cell1:SELECT=4 {{(pid=112043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:07.701828 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG dbcounter [-] [112043] Writing DB stats nova_api:SELECT=8 {{(pid=112043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:41:07.749698 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-8fb75d38-dd14-4d12-94c7-65cb0343821e admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:41:07.753159 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-8fb75d38-dd14-4d12-94c7-65cb0343821e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:41:07.753652 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-8fb75d38-dd14-4d12-94c7-65cb0343821e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:41:07.754089 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-8fb75d38-dd14-4d12-94c7-65cb0343821e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:41:07.754786 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-8fb75d38-dd14-4d12-94c7-65cb0343821e admin admin] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:41:07.755220 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-8fb75d38-dd14-4d12-94c7-65cb0343821e admin admin] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:41:07.755626 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-8fb75d38-dd14-4d12-94c7-65cb0343821e admin admin] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:41:07.779829 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-8fb75d38-dd14-4d12-94c7-65cb0343821e admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083643 Aug 31 11:41:07.780304 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 31 11:41:07 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:41:08.635143 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: DEBUG nova.api.openstack.wsgi [None req-91d3f9db-7e51-40b5-a432-955008a4f469 admin admin] Calling method '>' {{(pid=112044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:41:08.636132 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: INFO nova.api.openstack.requestlog [None req-91d3f9db-7e51-40b5-a432-955008a4f469 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001388 Aug 31 11:41:08.636555 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: [pid: 112044|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Aug 31 11:41:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:41:08.828309 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG nova.api.openstack.wsgi [None req-d1de9213-d1cc-4eeb-a2a9-e0b3043da9f4 admin admin] Calling method '>' {{(pid=112043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:41:08.831662 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-d1de9213-d1cc-4eeb-a2a9-e0b3043da9f4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:41:08.832133 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-d1de9213-d1cc-4eeb-a2a9-e0b3043da9f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:41:08.832592 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-d1de9213-d1cc-4eeb-a2a9-e0b3043da9f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:41:08.833327 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-d1de9213-d1cc-4eeb-a2a9-e0b3043da9f4 admin admin] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:41:08.833766 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-d1de9213-d1cc-4eeb-a2a9-e0b3043da9f4 admin admin] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:41:08.834180 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: DEBUG oslo_concurrency.lockutils [None req-d1de9213-d1cc-4eeb-a2a9-e0b3043da9f4 admin admin] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:41:08.856136 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: INFO nova.api.openstack.requestlog [None req-d1de9213-d1cc-4eeb-a2a9-e0b3043da9f4 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080701 Aug 31 11:41:08.856640 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: [pid: 112043|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Aug 31 11:41:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:42:08.341994 dv-cinder-839768-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 11:42:08.342559 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: Wed Aug 31 11:42:08 2022 - graceful shutdown triggered... Aug 31 11:42:08.342996 dv-cinder-839768-3-iscsi devstack@n-api.service[112043]: Gracefully killing worker 1 (pid: 112043)... Aug 31 11:42:08.343381 dv-cinder-839768-3-iscsi devstack@n-api.service[112044]: Gracefully killing worker 2 (pid: 112044)... Aug 31 11:42:09.343224 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: worker 1 buried after 1 seconds Aug 31 11:42:09.343832 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: worker 2 buried after 1 seconds Aug 31 11:42:09.343832 dv-cinder-839768-3-iscsi devstack@n-api.service[112042]: goodbye to uWSGI. Aug 31 11:42:09.344808 dv-cinder-839768-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 11:42:09.345357 dv-cinder-839768-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 11:42:09.348094 dv-cinder-839768-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 11:42:09.358181 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 11:42:09.360339 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 11:42:09 2022] *** Aug 31 11:42:09.360339 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 11:42:09.360339 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 11:42:09.360339 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: nodename: dv-cinder-839768-3-iscsi Aug 31 11:42:09.360339 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: machine: x86_64 Aug 31 11:42:09.360339 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: clock source: unix Aug 31 11:42:09.360339 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: pcre jit disabled Aug 31 11:42:09.360339 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: detected number of CPU cores: 4 Aug 31 11:42:09.360339 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: current working directory: / Aug 31 11:42:09.360339 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: detected binary path: /usr/bin/uwsgi-core Aug 31 11:42:09.361041 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: your processes number limit is 47680 Aug 31 11:42:09.361041 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: your memory page size is 4096 bytes Aug 31 11:42:09.361041 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: detected max file descriptor number: 2048 Aug 31 11:42:09.361041 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: lock engine: pthread robust mutexes Aug 31 11:42:09.361041 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: thunder lock: enabled Aug 31 11:42:09.361041 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 11:42:09.361041 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 11:42:09.403305 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: Python main interpreter initialized at 0x55fa32cc19c0 Aug 31 11:42:09.403305 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: python threads support enabled Aug 31 11:42:09.403305 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: your server socket listen backlog is limited to 100 connections Aug 31 11:42:09.403305 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: your mercy for graceful operations on workers is 90 seconds Aug 31 11:42:09.403764 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 11:42:09.403764 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: *** Operational MODE: preforking *** Aug 31 11:42:09.404058 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: *** uWSGI is running in multiple interpreter mode *** Aug 31 11:42:09.404058 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: spawned uWSGI master process (pid: 127041) Aug 31 11:42:09.404259 dv-cinder-839768-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 11:42:09.406758 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: spawned uWSGI worker 1 (pid: 127061, cores: 1) Aug 31 11:42:09.412986 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: spawned uWSGI worker 2 (pid: 127062, cores: 1) Aug 31 11:42:09.413492 dv-cinder-839768-3-iscsi devstack@n-api.service[127041]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 11:42:10.066536 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 11:42:10.068586 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 11:42:11.232136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:42:11.232136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: from cryptography.utils import int_from_bytes Aug 31 11:42:11.232839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:42:11.232839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: from cryptography.utils import int_from_bytes Aug 31 11:42:11.258644 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:42:11.258644 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: from cryptography.utils import int_from_bytes Aug 31 11:42:11.259197 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 11:42:11.259197 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: from cryptography.utils import int_from_bytes Aug 31 11:42:13.669361 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 11:42:13.669922 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 11:42:13.670199 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 11:42:13.670507 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 11:42:13.670761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 11:42:13.671150 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.673263 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.673263 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.673263 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.673263 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.673263 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.673263 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.673734 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.673813 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.674045 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.674366 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.674693 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-3-iscsi {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.675043 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.675327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.675642 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.675959 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.676267 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.676618 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.676932 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.677475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.678144 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.678390 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.678615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.678961 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.679280 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.679585 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.679904 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.680214 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.680569 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.680892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.681295 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-3-iscsi {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.681619 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.681924 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.682246 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.682679 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.682977 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.683287 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.683611 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.683932 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.684243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.684608 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.684921 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.685239 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.685557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.685863 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.686173 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.686488 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.687125 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.687125 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.687418 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.687648 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.687959 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.688284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.688654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.688979 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.689231 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.689482 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.689806 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.690130 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.690440 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.691003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.691313 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.691622 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.691931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.692244 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.692577 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.693005 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.693337 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.693660 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.693987 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.694300 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.694624 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.695038 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.695291 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.695601 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.695948 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.696269 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.696615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.696939 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.697268 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.697665 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.697878 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.698190 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.698507 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.698850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.699158 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.699410 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.699899 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.700213 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.700559 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.700871 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.701181 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.701491 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.701796 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.702106 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.702419 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.702728 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.703035 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.703349 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.703649 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.703958 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.704265 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.704648 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.704932 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.705252 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.705557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.705862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.706170 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.706475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.706795 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.707101 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.707409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.707735 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.708045 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.708362 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.709262 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.709576 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.709940 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.710210 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.710518 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.710827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.711148 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.711455 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.711762 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.712067 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.712379 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.712712 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.713022 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.713327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.713633 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.713933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.714255 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.714580 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.714893 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.715199 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.715506 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.715826 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.716169 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.716524 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.716888 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.717208 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.717547 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.717878 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.718200 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.718515 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.718831 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.719265 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.719547 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.719776 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.720090 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.720414 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.720764 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.721100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.721423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.721744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.722066 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.722426 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.722704 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.723037 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.723365 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.723704 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.724051 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.724983 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.725333 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.725646 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.726065 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.726385 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.726700 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.727015 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.727343 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.727691 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.728004 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.728326 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.728668 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.728996 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.729452 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.729737 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.730010 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.730323 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.730633 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.730978 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.731296 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.731621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.731944 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.732266 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.732611 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.732924 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.733239 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.733554 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.733856 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.734162 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.734469 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.734780 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.735088 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.735426 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.735762 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.736073 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.736411 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.736748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.737061 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.737377 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.737816 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.738029 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.738304 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.738615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.738923 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.739252 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.739687 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.739967 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.740237 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.740598 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.740918 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.741239 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.741552 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.741866 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.742184 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.742498 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.742829 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.743142 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.743454 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.743795 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.744128 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.744436 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.744791 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.745119 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.745553 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.745746 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.746056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.746366 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.746762 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.746977 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.747289 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.747597 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.747966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.748188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.748530 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.748827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.749156 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.749466 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.749872 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.750148 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.750365 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.750715 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.751025 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.751375 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.751716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.752038 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.752368 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.752729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.753051 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.753363 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.753676 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.753991 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.754300 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.754622 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.755004 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.755378 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.755783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.756120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.756550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.756904 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.757185 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.757505 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.757854 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.758208 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.758511 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.758838 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.759151 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.759467 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.759781 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.760121 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.760391 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.760744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.761066 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.761379 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.761698 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.762009 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.762340 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.762651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.763026 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.763277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.763592 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.763927 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.764344 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.764596 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.764911 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.765237 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.765547 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.765860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.766171 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.766481 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.766790 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.767104 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.767949 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.767949 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.768458 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.768458 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.768810 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.768951 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.769241 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.769546 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.769860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.770288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.770602 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.770800 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.771837 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.772244 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.772606 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.772942 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.773256 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.773565 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.773873 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.774282 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.774563 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.774827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.775134 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.775452 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.775775 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.776090 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.776406 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.776745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.777057 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.777380 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.777695 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.778007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.778318 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.778633 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.778946 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.779259 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.779581 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.779890 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.780201 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.780588 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.780847 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.781158 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.781473 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.782052 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.782388 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.782710 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.783032 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.783351 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.783696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.784028 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.784389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.784695 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.785002 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.785315 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.785557 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 11:42:13.786040 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 11:42:13.786278 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.786278 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.786668 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 11:42:13.787524 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.787772 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 11:42:13.787975 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.787975 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.788283 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 11:42:13.788481 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.788765 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.788765 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.789066 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.789226 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.789370 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.789520 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.789664 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.789664 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.789943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.790087 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.790230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.790372 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.790547 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.790880 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.791136 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.791291 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.791442 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.791586 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.791729 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.791873 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.792030 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.792181 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.792333 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-3-iscsi {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.792484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.792685 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.792829 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.792993 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.793161 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.793313 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.793457 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.793600 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.793752 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.793902 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.794046 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.794189 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.794331 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.794499 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.794765 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.795002 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.795188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.795334 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.795485 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.795738 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.795897 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.796047 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.796204 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.796439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.796649 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.796804 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.796957 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.797110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.797262 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.797262 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.797626 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.797626 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.797925 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.797925 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.798220 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.799098 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.799265 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.799421 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.799566 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-3-iscsi {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.799711 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.799874 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.800027 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.800178 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.800329 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.800480 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.800659 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.800821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.801151 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.801592 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.801751 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.801898 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.802042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.802042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.802891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.803045 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.803207 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.803363 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.803507 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.803650 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.803807 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.803960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.803960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.804236 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.804379 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.804555 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.804732 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.805000 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.805240 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.805389 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.805533 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.805742 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.805972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.806129 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.806273 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.806434 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.806654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.806819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.806972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.807128 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.807271 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.807413 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.807563 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.807805 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.807956 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.808100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.808242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.808385 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.808559 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.808723 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.808871 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.809021 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.809312 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.809473 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.809635 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.809785 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.809934 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.810090 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.810243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.810400 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.810550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.810699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.810847 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.811006 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.811346 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.811513 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.811705 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.811860 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.812010 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.812166 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.812325 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.812508 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.812678 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.812837 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.812994 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.813150 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.813318 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.813481 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.813638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.813795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.813944 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.813944 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.814249 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.814408 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.814408 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.814707 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.814857 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.814857 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.815269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.815768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.815939 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.816163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.816163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.816883 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.817278 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.817278 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.817866 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.818742 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.818742 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.819429 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.819609 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.819609 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.819920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.820079 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.820079 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.820386 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.820554 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.820554 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.820857 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.821008 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.821155 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.821541 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.821541 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.821846 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.822005 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.822175 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.822327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.822327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.822327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.822757 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.822757 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.823248 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.823408 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.823408 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.823718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.823870 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.823870 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.824163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.824320 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.824484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.824674 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.824827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.824975 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.825249 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.825510 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.825765 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.825928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.826290 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.826539 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.826539 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.826964 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.827132 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.827132 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.827426 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.827426 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.827426 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.827426 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.827426 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.827426 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.827426 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.827426 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.828588 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.828858 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.829057 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.829057 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.829767 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.830020 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.830231 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.830393 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.830393 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.830696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.830852 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.830852 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.831151 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.831300 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.831300 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.831857 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.832028 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.832181 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.832338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.832762 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.832930 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.833096 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.833248 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.833471 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.833713 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.833882 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.834042 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.834202 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.834405 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.834620 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.834778 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.834928 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.835084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.835263 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.835783 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.835783 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.836174 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.836325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.836325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.836742 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.836926 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.837170 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.837326 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.837487 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.837652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.837652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.837937 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.838086 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.838235 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.838384 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.838543 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.838700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.838875 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.839123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.839279 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.839485 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.839677 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.839922 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.840080 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.840237 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.840396 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.840581 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.840747 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.840905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.841061 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.841210 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.841379 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.841556 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.841791 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.842048 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 11:42:13.842205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.842356 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.842515 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.842679 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.842830 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.842978 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.843126 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.843275 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.843449 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.843598 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.843765 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.843918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.844067 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.844215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.844373 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.844542 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.844709 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.844868 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.845025 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.845197 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.845360 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.845537 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.845760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.845916 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.846159 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.846325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.846477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.846633 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.846873 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.847033 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.847198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.847429 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.847586 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.847735 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.847924 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.848084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.848241 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.848401 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.848628 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.848784 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.848935 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.849755 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.850079 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.850251 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.850411 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.850562 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.850733 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.850883 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.851044 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.851194 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.851353 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.851511 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.851662 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.851900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.852085 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.852339 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.852516 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.852685 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.852844 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.853011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.853177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.853177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.853177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.853177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.853177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.853938 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.854140 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.854306 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.854457 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.854612 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.854763 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.854921 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.855091 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.855242 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.855391 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.855547 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.855704 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.855704 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.856108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.856366 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.856586 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.856752 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.856991 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.857157 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.857308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.857557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.857714 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.857864 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.858022 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.858182 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.858340 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.858491 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.858640 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.858789 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.858947 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.859098 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.859247 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.859418 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.859569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.859765 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.859934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.860186 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.860351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.860521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.860689 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.860848 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.861006 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.861163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.861320 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.861477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.861638 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.861788 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.862102 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.862261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.862522 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.862690 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.862841 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.863000 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.863150 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.863313 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.863464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.863615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.863777 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.863948 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.864105 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.864263 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.864421 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.864718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.865464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.865636 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.865790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.865959 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.866200 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.866383 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.866613 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.866786 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.866974 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.867199 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.867354 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.867504 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.867752 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.867917 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.868075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.868225 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.868374 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.868543 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.868719 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.868871 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.869040 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.869191 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.869340 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.869496 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.869656 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.869860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.870025 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.870193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.870427 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.870656 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.870904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.871069 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.871069 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.871386 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.871546 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.871705 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.871855 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.872024 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.872263 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.872426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.872721 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.872891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.873051 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.873210 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.873361 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.873517 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.873687 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.873852 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.873852 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.874145 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.874302 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.874460 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.874610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.874768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.874918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.875067 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.875225 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.875375 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.875542 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.875700 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.875850 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.876006 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.876172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.876400 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.876609 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.876845 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.877001 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.877152 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.877390 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.877555 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.877738 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.877971 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.878127 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.878285 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.878444 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.878594 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.878753 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.878910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.879067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.879225 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.879391 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.879561 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.879712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.879954 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.880119 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.880309 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.880574 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.880745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.880941 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.881092 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.881242 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.881436 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.881614 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.881767 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.881916 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.882084 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.882252 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.882475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.882644 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.882903 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.883069 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.883221 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.883381 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.883538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.883710 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.883862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.884020 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.884178 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.884347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.884544 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.884715 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.884875 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.885026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.885191 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.885342 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.885500 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.885658 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.885807 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.885956 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.886105 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.886254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.886443 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.886677 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.886853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.886853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.887228 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.887404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.887635 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.887800 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.887970 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.888189 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.888189 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.888504 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.888691 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.888845 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.888995 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.889151 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.889300 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.889458 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.889615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.889765 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.889914 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.890111 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.890261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.890425 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.890598 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.890850 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.891014 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.891164 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.891313 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.891471 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.891629 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.891779 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.891930 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.892079 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.892236 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.892394 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.892658 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.892816 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.893089 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.893256 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.893256 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.893572 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.893727 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.893884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.894042 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.894191 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.894355 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.894515 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.894666 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.894823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.894972 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.895133 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.895292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.895449 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.895605 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.895755 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.895945 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.896107 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.896279 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.896438 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.896613 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.896865 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.897022 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.897286 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.897445 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.897613 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.897842 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.898004 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.898172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.898408 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.898571 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.898731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.898888 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.899040 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.899197 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.899357 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.899518 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.899677 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.899827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.899977 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.900176 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.900345 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.900573 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.900730 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.900983 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.901141 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.901305 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.901465 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.901622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.901795 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.901946 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.902106 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.902338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.902491 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.902659 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.902886 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.903067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.903313 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.903490 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.903646 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.903795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.903944 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.903944 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.903944 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.904383 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.904556 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.905257 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.905422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.905574 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.905783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.905949 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.906109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.906260 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.906410 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.906577 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.906743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.906985 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.907149 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.907395 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.907560 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.907722 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.907971 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.908137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.908294 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.908574 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.908745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.908897 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.909067 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.909218 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.909375 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.909524 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.909524 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.909827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.909977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.910134 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.910339 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.910499 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.910671 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.910831 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.912352 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.912612 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.912829 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.913113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.913315 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.913567 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.913733 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.913901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.914072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.914225 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.914383 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.914534 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.914693 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.914870 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.915024 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.915193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.915480 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.915638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.915638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.915943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.916104 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.916255 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.916412 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.916597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.916761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.916931 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.917204 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.917380 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.917622 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.917786 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.917971 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.918214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.918379 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.918379 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.918780 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.918938 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.919089 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.919248 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.919451 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.919451 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.919774 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.919933 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.920082 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.920278 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.920435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.920637 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.920790 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.920939 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.921095 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.921253 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.921413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.921575 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.921725 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.921874 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.922031 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.922189 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.928859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.929077 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.929244 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.929403 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.929568 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.929568 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.929891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.930068 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.930068 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.930423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.930423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.931468 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.931625 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.931778 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.932601 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.932783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.932948 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.933117 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.933338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.933572 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.934880 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.935691 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.936571 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.937340 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.937512 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.937669 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.937669 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.938159 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.938159 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.938504 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.938672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.940774 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.941078 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.941233 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.941366 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.941496 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.941496 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.941741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.941880 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.942026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.942156 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.942287 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.942424 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.942554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.942702 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.942912 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.943088 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.943266 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.943502 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.943758 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.943905 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.943905 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.944156 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.944270 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.944483 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.944653 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.944994 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.945136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.945268 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.945399 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.945530 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.945670 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.945800 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.945940 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.946079 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.946210 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.946339 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.946485 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.946623 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.946754 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.947015 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.947151 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.947295 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.947426 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.947565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.947695 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.947824 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.947953 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.948091 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.948221 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.948350 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.948503 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.948635 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.948779 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.948934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.949176 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.949381 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.949515 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.949646 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.949775 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.949919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.950050 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.950188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.950326 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.950470 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.950720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.950854 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.950985 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.951123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.951262 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.951400 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.951545 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.951689 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.951822 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.951950 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.952087 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.952087 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.952349 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.952557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.952705 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.952839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.952967 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.953179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.953327 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.953459 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.953595 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.953734 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.953866 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.954010 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.954157 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.954288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.954418 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.954551 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.954688 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.954827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.954969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.955107 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.955237 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.955366 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.955502 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.955641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.955772 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.955910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.955910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.956166 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.956304 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.956448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.956590 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.956719 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.956848 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.956848 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.957192 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.957327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.957465 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.957595 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.957595 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.957838 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.957975 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.957975 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.958220 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.958387 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.958387 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.958648 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.958788 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.958788 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.958788 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.958788 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.959397 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.959613 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.959750 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.959888 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.959888 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.960136 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.960264 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.960407 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.960554 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.960554 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.960832 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.960964 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.960964 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.961228 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.961367 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.961367 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 11:42:13.961611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.961611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.961611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.961611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.961611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.961611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.961611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.961611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.962584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.962584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.962584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.962584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.962584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.962584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.962584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.962584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.963607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.963607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.963607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.963607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.963607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.963607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.963607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.963607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.964441 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.964441 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.964441 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.964441 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.964441 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.964441 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.964441 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.964441 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.965596 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.965596 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.965596 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.965596 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.965596 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.965596 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.965596 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.965596 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.966580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.966580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.966580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.966580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.966580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.966580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.966580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.966580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.967654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.967654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.967654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.967654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.967654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.967654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.967654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.967654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.968659 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.968659 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.968659 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.968659 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.968659 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.968659 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.968659 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.968659 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.969827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.969827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.969827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.969827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.969827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.969827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.969827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.969827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.970597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.970597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.970597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.970597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.970597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.970597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.970597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.970597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.971171 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.971171 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.971171 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.971171 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.971479 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.971728 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.972026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.972357 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.972773 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.973123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.973482 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.973849 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.975093 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.975604 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.975947 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.976263 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.976615 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.976941 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.977262 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.977576 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.977888 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.978220 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.978533 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.978865 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.979186 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.979517 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.979854 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.980167 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.980509 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.980868 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.981186 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.981501 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.981861 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.982213 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.982526 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.982855 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.983194 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.983530 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.983847 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.984198 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.984541 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.984870 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.985197 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.985532 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.985845 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.986157 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.986475 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.986786 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.987100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.987412 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.987731 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.988042 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.988353 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.988687 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.989016 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.989327 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.990360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.990959 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.991303 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.991622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.991938 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.992289 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.992632 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.992975 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.993295 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.993631 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.993957 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.994281 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.994604 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.994928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.995251 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.995570 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.995889 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.996202 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.997137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.997137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.997320 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.997732 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.998069 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.998390 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.998710 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.999030 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.999351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:13.999670 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.000122 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.000538 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.000794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.001190 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.001444 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.001772 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.002105 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.002450 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.002778 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.003099 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.003420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.003739 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.004103 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.004424 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.004762 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.005081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.005493 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.006056 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.006388 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.006712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.007037 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.007361 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.007682 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.008001 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.008322 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.008668 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.008998 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.009340 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.009670 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.009993 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.010318 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.010645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.011178 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.011500 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.011838 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.012170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.012508 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.012847 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.013171 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.013505 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.013818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.014129 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.014445 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.014759 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.015070 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.015395 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.015712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.016021 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.016406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.016747 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.017369 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.017729 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.018057 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.018391 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.018725 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.019050 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.019365 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.019699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.020015 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.020337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.020984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.021549 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.021972 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.022289 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.022614 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.022934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.023247 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.023568 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.023880 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.024228 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.024544 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.024703 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO dbcounter [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] Registered counter for database nova_api Aug 31 11:42:14.024866 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.025163 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.025482 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.025794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.026106 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.026417 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.026729 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.027052 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.027363 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.027679 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.027990 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.028308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.028644 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.028963 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.029331 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.029663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.029978 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.030300 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.030625 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.030943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.031275 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.031596 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.031917 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.032270 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.032629 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.033185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.033529 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.033858 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.034197 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.034534 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.034846 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.035156 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.035467 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.035798 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.036116 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.036432 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.037409 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.037923 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.038248 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.038571 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.038891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.039211 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.039531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.039899 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.040168 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.040520 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.040832 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.041147 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.041491 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.041825 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.042299 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.042473 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.042795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.043120 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.043437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.043754 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.044116 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.044723 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.044897 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.045190 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.045509 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.045822 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.046278 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.046860 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.046860 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.047397 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.047695 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.047844 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.048140 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.048459 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.048809 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.049127 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.049464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.049815 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.050180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.050497 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.050803 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.051117 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.051434 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.051753 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.052084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.053226 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.053603 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.054023 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.054131 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_db.sqlalchemy.engines [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:42:14.054495 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.054662 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.054977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.055294 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.055606 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.055923 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.056234 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.056570 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.056884 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.057195 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.057505 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.057814 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.058130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.058441 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.058750 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.059061 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.059372 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.059683 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.060022 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.060369 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.060718 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.061046 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.061367 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.061727 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.062012 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.062299 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writer thread running {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:42:14.062457 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.062657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.062982 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.063299 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.063637 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.063954 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.064271 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.064611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.064930 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.065248 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.065814 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.066148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.066481 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.066793 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.067125 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.067444 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.067808 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.068322 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.068829 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.069173 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.069496 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.069819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.070147 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.070468 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.070790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.071097 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.071422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.071746 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.072073 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.072394 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.072753 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.073087 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.073407 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.073737 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.074069 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.074422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.074739 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.075090 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.075426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.075752 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.076068 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.076379 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 11:42:14.076650 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 11:42:14.120829 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.context [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e384889-6636-4480-9f30-0e4cdfea2d8c(cell1) {{(pid=127061) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 11:42:14.124898 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:42:14.125370 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:42:14.126918 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:42:14.127642 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:42:14.128080 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:42:14.130057 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:42:14.132135 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO dbcounter [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] Registered counter for database nova_cell0 Aug 31 11:42:14.136160 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO dbcounter [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] Registered counter for database nova_cell1 Aug 31 11:42:14.140543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO dbcounter [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] Registered counter for database nova_api Aug 31 11:42:14.143430 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_db.sqlalchemy.engines [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:42:14.145556 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_db.sqlalchemy.engines [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:42:14.153637 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writer thread running {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:42:14.154037 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writer thread running {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:42:14.166039 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_db.sqlalchemy.engines [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:42:14.173238 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writer thread running {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:42:14.233706 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.context [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e384889-6636-4480-9f30-0e4cdfea2d8c(cell1) {{(pid=127062) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 11:42:14.237788 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:42:14.238269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:42:14.239908 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:42:14.240971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:42:14.241424 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:42:14.243431 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:42:14.245483 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO dbcounter [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] Registered counter for database nova_cell0 Aug 31 11:42:14.249885 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO dbcounter [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] Registered counter for database nova_cell1 Aug 31 11:42:14.259322 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_db.sqlalchemy.engines [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:42:14.264968 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_db.sqlalchemy.engines [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:42:14.266008 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writer thread running {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:42:14.311676 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO dbcounter [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] Registered counter for database nova_cell0 Aug 31 11:42:14.320222 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_db.sqlalchemy.engines [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:42:14.324824 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writer thread running {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:42:14.418233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writer thread running {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:42:14.428043 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO dbcounter [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] Registered counter for database nova_cell0 Aug 31 11:42:14.436682 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_db.sqlalchemy.engines [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 11:42:14.441465 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writer thread running {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 11:42:14.640125 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: WARNING keystonemiddleware.auth_token [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 11:42:14.647901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: WARNING keystonemiddleware.auth_token [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 11:42:14.760824 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: WARNING keystonemiddleware.auth_token [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 11:42:14.768114 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: WARNING keystonemiddleware.auth_token [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 11:42:14.992257 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: WARNING keystonemiddleware.auth_token [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 11:42:14.999186 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: WARNING keystonemiddleware.auth_token [None req-de58f746-37ef-4df8-99af-6ed0b0ca751b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 11:42:15.004625 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fa32cc19c0 pid: 127061 (default app) Aug 31 11:42:15.123134 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: WARNING keystonemiddleware.auth_token [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 11:42:15.129178 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: WARNING keystonemiddleware.auth_token [None req-61b5f70c-4f71-46ef-85d4-32e7b03e050a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 11:42:15.135138 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fa32cc19c0 pid: 127062 (default app) Aug 31 11:42:54.022821 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=3 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:54.023955 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=3 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:54.029003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=3 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:54.033628 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=3 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:54.364157 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a73de062-9fe3-49ea-a378-9c2169f0cf45 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] Calling method '.version_select at 0x7f17359a5940>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:42:54.874072 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a73de062-9fe3-49ea-a378-9c2169f0cf45 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/dc94a50b-5450-4cb5-8f21-235a801e0624" status: 200 len: 351 microversion: 2.1 time: 0.864169 Aug 31 11:42:54.874672 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 1/1] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:42:54 2022] GET /compute/v2.1/os-volumes/dc94a50b-5450-4cb5-8f21-235a801e0624 => generated 351 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:42:56.573124 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=3 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:56.575013 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=3 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:56.575967 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=3 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:56.576945 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=3 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:42:56.842629 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-be20243a-cdb1-4df1-b5b5-b3d7161281b9 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] Calling method '.version_select at 0x7f17359a1af0>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:42:57.165330 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-be20243a-cdb1-4df1-b5b5-b3d7161281b9 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/54c0e3c5-4a09-43f7-ad20-f46d5bb654b7" status: 200 len: 351 microversion: 2.1 time: 0.599406 Aug 31 11:42:57.173460 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 1/2] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:42:56 2022] GET /compute/v2.1/os-volumes/54c0e3c5-4a09-43f7-ad20-f46d5bb654b7 => generated 351 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:42:58.996261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ebe2c5ea-c420-45a8-ae5c-8293b0bad3ac tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] Calling method '.version_select at 0x7f173586dca0>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:42:59.071785 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ebe2c5ea-c420-45a8-ae5c-8293b0bad3ac tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/791c29d1-b707-47d5-8bc5-4409924e2277" status: 200 len: 350 microversion: 2.1 time: 0.079751 Aug 31 11:42:59.074269 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:42:58 2022] GET /compute/v2.1/os-volumes/791c29d1-b707-47d5-8bc5-4409924e2277 => generated 350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:42:59.088704 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a628d598-438e-4593-a155-9544d38aa64c tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] Calling method '.version_select at 0x7f1735869c10>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:42:59.193649 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a628d598-438e-4593-a155-9544d38aa64c tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.109719 Aug 31 11:42:59.204704 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Aug 31 11:42:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:42:59.208796 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-da1414de-1211-4116-a95a-220085199ba0 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] Calling method '.version_select at 0x7f173582d3a0>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:42:59.363069 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-da1414de-1211-4116-a95a-220085199ba0 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.158402 Aug 31 11:42:59.364967 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 3/5] 10.222.0.60 () {58 vars in 1149 bytes} [Wed Aug 31 11:42:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:42:59.381127 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8a80a37b-268a-4049-bcbd-a1b71784b1b3 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] Calling method '.version_select at 0x7f17358288b0>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:42:59.511757 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8a80a37b-268a-4049-bcbd-a1b71784b1b3 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.136043 Aug 31 11:42:59.522308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 3/6] 10.222.0.60 () {58 vars in 1134 bytes} [Wed Aug 31 11:42:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:42:59.539553 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a60b4ae8-d929-467a-ac47-5656e66aca16 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] Calling method '.version_select at 0x7f173586daf0>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:42:59.727188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a60b4ae8-d929-467a-ac47-5656e66aca16 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.200006 Aug 31 11:42:59.727771 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1167 bytes} [Wed Aug 31 11:42:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:42:59.748857 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8cf2b46c-0363-44dc-97c9-5783fe6790e4 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] Calling method '.version_select at 0x7f173583fca0>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:42:59.982343 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8cf2b46c-0363-44dc-97c9-5783fe6790e4 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.244299 Aug 31 11:42:59.998110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1170 bytes} [Wed Aug 31 11:42:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:42:59.999543 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0a816acc-75f8-4975-bf2f-e89cc82fe882 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] Calling method '.version_select at 0x7f1735842ca0>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:00.243876 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0a816acc-75f8-4975-bf2f-e89cc82fe882 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.249801 Aug 31 11:43:00.244737 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 5/9] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Aug 31 11:42:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:00.265410 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-de605fe3-4b48-4012-a431-1a9f7370b2f0 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] Calling method '.version_select at 0x7f173583fb80>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:00.494559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-de605fe3-4b48-4012-a431-1a9f7370b2f0 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.235590 Aug 31 11:43:00.501053 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 5/10] 10.222.0.60 () {58 vars in 1188 bytes} [Wed Aug 31 11:43:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:43:00.509533 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d890c6ae-d24f-473f-8f41-f5352e8a8800 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] Calling method '.version_select at 0x7f173582d310>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:00.649484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d890c6ae-d24f-473f-8f41-f5352e8a8800 tempest-VolumesTestJSON-1693251001 tempest-VolumesTestJSON-1693251001-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.143996 Aug 31 11:43:00.650061 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 6/11] 10.222.0.60 () {58 vars in 1155 bytes} [Wed Aug 31 11:43:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:06.669081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9587a71f-349a-4f36-81b1-b25e6845abce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Action: 'create', calling method: .version_select at 0x7f17358289d0>, body: {"keypair": {"name": "tempest-keypair-1877806679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrNZ/bKug9ZbYIE2DQDgnvxgwtJ5a5XkKmg1JzlJ7XGcL6fwH7cJUH3YJLdP+afLWa+Oj3C93TgJR4RsMgsC8SDsqo6QABQl98eHfQUacIt5EUucVt/e3l7Volnh1504g=="}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:43:06.776348 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-9587a71f-349a-4f36-81b1-b25e6845abce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Getting quotas for project 23acf169856c41d888a1d4c0e61cfee2. Resources: {'key_pairs'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:43:06.789943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-9587a71f-349a-4f36-81b1-b25e6845abce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Getting quotas for user bcd4602a40964a81931cdadc92d7f281 and project 23acf169856c41d888a1d4c0e61cfee2. Resources: {'key_pairs'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:43:06.891296 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9587a71f-349a-4f36-81b1-b25e6845abce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.937628 Aug 31 11:43:06.896644 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 6/12] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Aug 31 11:43:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 940 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 11:43:07.307066 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7b0a57ca-d92c-4280-af5d-05f6a838b580 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Action: 'create', calling method: .version_select at 0x7f1735849820>, body: {"keypair": {"name": "tempest-keypair-4827966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsG0ysUq92ovnATXuHK0IpsIQwoGBt4rM9quVyd2HMVq8WfjlZ2JWHnZnFY/f0UhvFIsnIUeu+LO7FGN5+3BfKJejOyfz5f2/UDNR4rWGTMeKr/gYfBNAFPtiCnOENFLA=="}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:43:07.421799 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-7b0a57ca-d92c-4280-af5d-05f6a838b580 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Getting quotas for project aacdfff11f2a41f889f7d7cdc41c12dc. Resources: {'key_pairs'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:43:07.450079 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-7b0a57ca-d92c-4280-af5d-05f6a838b580 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Getting quotas for user 38c4d208994a40fe82310adb18bb3547 and project aacdfff11f2a41f889f7d7cdc41c12dc. Resources: {'key_pairs'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:43:07.621972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7b0a57ca-d92c-4280-af5d-05f6a838b580 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.679399 Aug 31 11:43:07.633821 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 7/13] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 31 11:43:06 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:43:10.503031 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0cd4ab4d-8b48-4b79-9fe5-1c02c98c6dd6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Action: 'create', calling method: .version_select at 0x7f1735794a60>, body: {"keypair": {"name": "tempest-keypair-77335979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQJvimw8mosIt9e1EUWq6bLVqBZ7n4XKpvpMBC6E6RkID5UHjR7oHiIXO7sO88rUTvcmqRRHYjxefy5KOraiWy4c77NuVmUAZLRQK/V4EDDDbnoNMIZylCPbkaAFOOIzQ=="}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:43:10.552175 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-0cd4ab4d-8b48-4b79-9fe5-1c02c98c6dd6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for project b4ac4dc41f7e420d811483990e020f22. Resources: {'key_pairs'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:43:10.563355 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-0cd4ab4d-8b48-4b79-9fe5-1c02c98c6dd6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for user 5de832888ffd4a69ae88cac6b632304e and project b4ac4dc41f7e420d811483990e020f22. Resources: {'key_pairs'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:43:10.622447 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0cd4ab4d-8b48-4b79-9fe5-1c02c98c6dd6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.737915 Aug 31 11:43:10.624346 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 7/14] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 31 11:43:09 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:43:14.852187 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-466640704", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "networks": [{"uuid": "a18b2451-4391-4a58-9550-344d2601adef"}]}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:43:14.979090 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1730984638", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f4395ed-c7d4-48e6-8582-4664b70541e8"}], "security_groups": [{"name": "tempest-securitygroup--1037997439"}], "key_name": "tempest-keypair-1877806679", "user_data": "}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:43:15.107574 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.network.neutron [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] validate_networks() for [('a18b2451-4391-4a58-9550-344d2601adef', None, None, None, None, None)] {{(pid=127061) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:43:15.329889 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.network.neutron [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] validate_networks() for [('0f4395ed-c7d4-48e6-8582-4664b70541e8', None, None, None, None, None)] {{(pid=127062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:43:17.502205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=4 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:17.882993 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Flavor limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:43:17.884647 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Image limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:43:17.885685 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Flavor pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:43:17.886295 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Image pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:43:17.887227 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:43:17.900710 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:17.901677 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:17.902303 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:17.905633 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:17.906470 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:17.907237 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:17.965389 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Getting quotas for project 23acf169856c41d888a1d4c0e61cfee2. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:43:17.970197 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Getting quotas for user bcd4602a40964a81931cdadc92d7f281 and project 23acf169856c41d888a1d4c0e61cfee2. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:43:17.984532 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Going to run 1 instances... {{(pid=127062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:43:17.988171 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:43:18.130157 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4774d950-b470-4ab1-95a5-7edb4ee44dc6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.163616 Aug 31 11:43:18.131858 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 8/15] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Aug 31 11:43:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 3166 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 11:43:18.555253 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Flavor limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:43:18.555675 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Image limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:43:18.556147 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Flavor pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:43:18.557041 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Image pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:43:18.557794 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:43:18.567962 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:18.568921 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:18.569557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:18.570582 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:18.571338 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:18.572056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:18.624316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Getting quotas for project 11a0149745754ac59b97e489312dd3ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:43:18.629324 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Getting quotas for user 0d27f92c992749cfa5502babb56cb5a4 and project 11a0149745754ac59b97e489312dd3ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:43:18.646528 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Going to run 1 instances... {{(pid=127061) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:43:18.649883 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127061) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:43:18.712215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-838497248", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:43:18.830930 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.network.neutron [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] validate_networks() for [('b93944f3-e7dd-4293-9c55-c0bafd4cda29', None, None, None, None, None)] {{(pid=127062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:43:18.860280 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e8553a62-19a0-4012-987f-0df78f39e2d2 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.502675 Aug 31 11:43:18.860993 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 8/16] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:43:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 4507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:43:18.871355 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-969745224", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77a78692-a74d-4bab-91f2-992291597120"}], "security_groups": [{"name": "tempest-securitygroup--1505832279"}], "key_name": "tempest-keypair-4827966", "user_data": "}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:43:19.114157 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.network.neutron [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] validate_networks() for [('77a78692-a74d-4bab-91f2-992291597120', None, None, None, None, None)] {{(pid=127061) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:43:19.982652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Flavor limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:43:19.984957 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Image limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:43:19.985899 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Flavor pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:43:19.986482 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Image pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:43:19.990978 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:43:20.027093 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:20.027594 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:20.028025 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:20.028783 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:20.035285 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:20.036680 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:20.105223 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Getting quotas for project 0e110109075848a89e6ae1d516de9784. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:43:20.112464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Getting quotas for user 38ea91bf04e741c793e4a06db9fb046f and project 0e110109075848a89e6ae1d516de9784. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:43:20.130674 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Going to run 1 instances... {{(pid=127062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:43:20.135219 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:43:20.298927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0c526dd0-60a6-4d90-be86-d50c5014c36a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.165901 Aug 31 11:43:20.307897 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 9/17] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:43:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:43:20.329266 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e1b75256-c75c-44c8-982d-221d8f62182f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:20.329899 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e1b75256-c75c-44c8-982d-221d8f62182f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:20.371645 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Flavor limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:43:20.373416 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Image limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:43:20.374394 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Flavor pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:43:20.374945 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Image pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:43:20.375496 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:43:20.402822 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:20.403316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:20.403755 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:20.404514 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:20.404955 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:20.405374 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:20.482878 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Getting quotas for project aacdfff11f2a41f889f7d7cdc41c12dc. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:43:20.501922 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Getting quotas for user 38c4d208994a40fe82310adb18bb3547 and project aacdfff11f2a41f889f7d7cdc41c12dc. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:43:20.536115 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Going to run 1 instances... {{(pid=127061) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:43:20.539398 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127061) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:43:20.589837 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e1b75256-c75c-44c8-982d-221d8f62182f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:20.685364 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e1b75256-c75c-44c8-982d-221d8f62182f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:20.691263 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e1b75256-c75c-44c8-982d-221d8f62182f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:20.692234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5defe156-ff5d-4f63-bc44-8e56949a4d95 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.825754 Aug 31 11:43:20.700372 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 9/18] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:43:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:43:20.700986 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e1b75256-c75c-44c8-982d-221d8f62182f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1282 microversion: 2.20 time: 0.384800 Aug 31 11:43:20.700986 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 10/19] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:20 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1282 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:20.706579 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2fe2c40b-8d1a-45ad-b476-6158f07d82a1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:20.708845 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2fe2c40b-8d1a-45ad-b476-6158f07d82a1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:20.725829 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1791748727", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5aa6b83-6517-47ce-979a-ff78821ec50d"}], "security_groups": [{"name": "tempest-securitygroup--1172727837"}], "key_name": "tempest-keypair-77335979", "user_data": "}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:43:20.993269 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2fe2c40b-8d1a-45ad-b476-6158f07d82a1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:21.006315 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.network.neutron [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] validate_networks() for [('e5aa6b83-6517-47ce-979a-ff78821ec50d', None, None, None, None, None)] {{(pid=127062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:43:21.030527 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2fe2c40b-8d1a-45ad-b476-6158f07d82a1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1214 microversion: 2.1 time: 0.334299 Aug 31 11:43:21.031104 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 10/20] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:20 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1214 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:21.058848 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fdbc32c8-7a54-4568-be5e-812deb5f72bc tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:21.062961 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fdbc32c8-7a54-4568-be5e-812deb5f72bc tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:21.244653 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-fdbc32c8-7a54-4568-be5e-812deb5f72bc tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:21.258193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-fdbc32c8-7a54-4568-be5e-812deb5f72bc tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1221 microversion: 2.1 time: 0.221150 Aug 31 11:43:21.258859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 11/21] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:21 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1221 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:21.267192 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3365077f-2cf6-4929-911a-f1582eb0b461 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:21.267813 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3365077f-2cf6-4929-911a-f1582eb0b461 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:21.447855 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3365077f-2cf6-4929-911a-f1582eb0b461 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:21.455601 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3365077f-2cf6-4929-911a-f1582eb0b461 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1234 microversion: 2.1 time: 0.195685 Aug 31 11:43:21.456219 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 12/22] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:21 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1234 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:21.691345 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-802470246", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:43:21.817350 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.network.neutron [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] validate_networks() for [('b93944f3-e7dd-4293-9c55-c0bafd4cda29', None, None, None, None, None)] {{(pid=127061) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:43:22.036455 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Flavor limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:43:22.042341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Image limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:43:22.043825 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Flavor pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:43:22.044258 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Image pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:43:22.046775 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:43:22.067261 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:22.067756 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:22.068198 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:22.068964 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:22.070231 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:22.072659 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:22.116304 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for project b4ac4dc41f7e420d811483990e020f22. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:43:22.124715 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for user 5de832888ffd4a69ae88cac6b632304e and project b4ac4dc41f7e420d811483990e020f22. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:43:22.149361 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Going to run 1 instances... {{(pid=127062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:43:22.151616 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:43:22.262363 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c7e6c6e9-c4a9-4849-9244-69ddcb4b2bcb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.562447 Aug 31 11:43:22.263128 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 11/23] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:43:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:43:22.275600 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3bf7fe7e-9a3c-46fd-8c3d-d9ffe7b74b7f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:22.276333 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3bf7fe7e-9a3c-46fd-8c3d-d9ffe7b74b7f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:22.288569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3bf7fe7e-9a3c-46fd-8c3d-d9ffe7b74b7f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:22.289682 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3bf7fe7e-9a3c-46fd-8c3d-d9ffe7b74b7f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:22.290398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3bf7fe7e-9a3c-46fd-8c3d-d9ffe7b74b7f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:22.291526 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3bf7fe7e-9a3c-46fd-8c3d-d9ffe7b74b7f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:22.292178 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3bf7fe7e-9a3c-46fd-8c3d-d9ffe7b74b7f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:22.293035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3bf7fe7e-9a3c-46fd-8c3d-d9ffe7b74b7f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:22.506731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Flavor limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:43:22.507961 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Image limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:43:22.508696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Flavor pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:43:22.509260 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Image pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:43:22.509822 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:43:22.524530 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:22.525302 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:22.526142 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:22.527488 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:22.528403 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:22.529853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:22.553085 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3bf7fe7e-9a3c-46fd-8c3d-d9ffe7b74b7f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:22.556088 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Getting quotas for project 0e110109075848a89e6ae1d516de9784. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:43:22.562450 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Getting quotas for user 38ea91bf04e741c793e4a06db9fb046f and project 0e110109075848a89e6ae1d516de9784. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:43:22.573164 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3bf7fe7e-9a3c-46fd-8c3d-d9ffe7b74b7f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:22.574727 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3bf7fe7e-9a3c-46fd-8c3d-d9ffe7b74b7f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:22.575927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3bf7fe7e-9a3c-46fd-8c3d-d9ffe7b74b7f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1286 microversion: 2.20 time: 0.304497 Aug 31 11:43:22.581051 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 12/24] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:22 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1286 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:22.589001 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-106688ca-94a9-4476-b9cf-53df9557f03e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:22.590129 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-106688ca-94a9-4476-b9cf-53df9557f03e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:22.590484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Going to run 1 instances... {{(pid=127061) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:43:22.597767 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127061) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:43:22.603644 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-106688ca-94a9-4476-b9cf-53df9557f03e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:22.604458 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-106688ca-94a9-4476-b9cf-53df9557f03e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:22.605179 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-106688ca-94a9-4476-b9cf-53df9557f03e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:22.610583 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-106688ca-94a9-4476-b9cf-53df9557f03e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:22.611286 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-106688ca-94a9-4476-b9cf-53df9557f03e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:22.611918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-106688ca-94a9-4476-b9cf-53df9557f03e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:22.723999 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8c09faaf-aa2c-4097-80c8-264bf2827713 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.037903 Aug 31 11:43:22.725035 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 13/25] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:43:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:43:22.732618 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-45431440-d1b5-4760-a718-b4295216d9ec tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:22.733717 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-45431440-d1b5-4760-a718-b4295216d9ec tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:22.756641 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-106688ca-94a9-4476-b9cf-53df9557f03e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:22.799552 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-106688ca-94a9-4476-b9cf-53df9557f03e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1218 microversion: 2.1 time: 0.212689 Aug 31 11:43:22.804191 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-45431440-d1b5-4760-a718-b4295216d9ec tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:22.817871 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 13/26] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:22 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1218 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:22.819644 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-45431440-d1b5-4760-a718-b4295216d9ec tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1240 microversion: 2.1 time: 0.093172 Aug 31 11:43:22.821724 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 14/27] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:22 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:22.831786 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-955b7e56-5d31-46fc-9371-495b28193591 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:22.836207 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-955b7e56-5d31-46fc-9371-495b28193591 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:22.857137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7b4dbe32-755d-4dc4-9b68-72d3dcfdd24b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:22.858783 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-7b4dbe32-755d-4dc4-9b68-72d3dcfdd24b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:22.888850 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b4dbe32-755d-4dc4-9b68-72d3dcfdd24b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:22.893235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b4dbe32-755d-4dc4-9b68-72d3dcfdd24b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:22.895907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b4dbe32-755d-4dc4-9b68-72d3dcfdd24b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:22.900520 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b4dbe32-755d-4dc4-9b68-72d3dcfdd24b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:22.901830 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b4dbe32-755d-4dc4-9b68-72d3dcfdd24b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:22.908683 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b4dbe32-755d-4dc4-9b68-72d3dcfdd24b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:23.068024 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-955b7e56-5d31-46fc-9371-495b28193591 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:23.089332 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-955b7e56-5d31-46fc-9371-495b28193591 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1221 microversion: 2.1 time: 0.265762 Aug 31 11:43:23.094579 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 15/28] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:22 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1221 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:23.126181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7b4dbe32-755d-4dc4-9b68-72d3dcfdd24b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:23.156900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-7b4dbe32-755d-4dc4-9b68-72d3dcfdd24b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1238 microversion: 2.1 time: 0.334943 Aug 31 11:43:23.158023 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 14/29] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:22 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1238 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:23.608787 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-12ec2314-f9eb-44ba-a16f-d868e7e13457 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:23.610774 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-12ec2314-f9eb-44ba-a16f-d868e7e13457 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:23.621114 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-12ec2314-f9eb-44ba-a16f-d868e7e13457 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:23.622252 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-12ec2314-f9eb-44ba-a16f-d868e7e13457 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:23.622996 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-12ec2314-f9eb-44ba-a16f-d868e7e13457 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:23.624324 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-12ec2314-f9eb-44ba-a16f-d868e7e13457 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:23.625241 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-12ec2314-f9eb-44ba-a16f-d868e7e13457 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:23.625961 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-12ec2314-f9eb-44ba-a16f-d868e7e13457 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:23.833840 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8433ab52-a355-4fe0-a219-79170c9767c7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:23.836526 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8433ab52-a355-4fe0-a219-79170c9767c7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:23.859541 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8433ab52-a355-4fe0-a219-79170c9767c7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:23.861690 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8433ab52-a355-4fe0-a219-79170c9767c7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:23.865596 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8433ab52-a355-4fe0-a219-79170c9767c7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:23.867253 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8433ab52-a355-4fe0-a219-79170c9767c7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:23.867743 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8433ab52-a355-4fe0-a219-79170c9767c7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:23.869600 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8433ab52-a355-4fe0-a219-79170c9767c7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:23.916314 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-12ec2314-f9eb-44ba-a16f-d868e7e13457 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:23.936427 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-12ec2314-f9eb-44ba-a16f-d868e7e13457 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:23.938002 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-12ec2314-f9eb-44ba-a16f-d868e7e13457 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:23.939136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-12ec2314-f9eb-44ba-a16f-d868e7e13457 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1334 microversion: 2.20 time: 0.338948 Aug 31 11:43:23.949838 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 16/30] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:23 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1334 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:23.955825 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-652069b9-880d-4a37-b64d-a29a4cad3940 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:23.957075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-652069b9-880d-4a37-b64d-a29a4cad3940 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:23.980702 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-652069b9-880d-4a37-b64d-a29a4cad3940 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:23.981384 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-652069b9-880d-4a37-b64d-a29a4cad3940 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:23.981961 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-652069b9-880d-4a37-b64d-a29a4cad3940 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:23.982873 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-652069b9-880d-4a37-b64d-a29a4cad3940 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:23.983533 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-652069b9-880d-4a37-b64d-a29a4cad3940 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:23.984138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-652069b9-880d-4a37-b64d-a29a4cad3940 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:24.106181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8433ab52-a355-4fe0-a219-79170c9767c7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:24.124119 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8433ab52-a355-4fe0-a219-79170c9767c7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1210 microversion: 2.1 time: 0.302163 Aug 31 11:43:24.138118 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 15/31] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:23 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1210 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:24.180042 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9711d3ff-0673-4aa5-bf7a-3e86549e3768 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:24.181113 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9711d3ff-0673-4aa5-bf7a-3e86549e3768 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:24.210691 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9711d3ff-0673-4aa5-bf7a-3e86549e3768 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:24.212742 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9711d3ff-0673-4aa5-bf7a-3e86549e3768 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:24.215165 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9711d3ff-0673-4aa5-bf7a-3e86549e3768 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:24.216749 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9711d3ff-0673-4aa5-bf7a-3e86549e3768 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:24.218014 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9711d3ff-0673-4aa5-bf7a-3e86549e3768 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:24.219762 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9711d3ff-0673-4aa5-bf7a-3e86549e3768 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:24.296945 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-652069b9-880d-4a37-b64d-a29a4cad3940 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:24.307010 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-652069b9-880d-4a37-b64d-a29a4cad3940 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1236 microversion: 2.1 time: 0.355092 Aug 31 11:43:24.307662 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 17/32] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:23 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1236 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:24.315187 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9711d3ff-0673-4aa5-bf7a-3e86549e3768 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:24.324813 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9711d3ff-0673-4aa5-bf7a-3e86549e3768 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1225 microversion: 2.1 time: 0.182537 Aug 31 11:43:24.325568 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 16/33] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:24 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1225 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:24.352260 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ac313a67-5749-4c35-bc74-e62c03116ee7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:24.352914 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ac313a67-5749-4c35-bc74-e62c03116ee7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:24.369514 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac313a67-5749-4c35-bc74-e62c03116ee7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:24.370130 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac313a67-5749-4c35-bc74-e62c03116ee7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:24.370759 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac313a67-5749-4c35-bc74-e62c03116ee7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:24.373130 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac313a67-5749-4c35-bc74-e62c03116ee7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:24.373926 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac313a67-5749-4c35-bc74-e62c03116ee7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:24.374785 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac313a67-5749-4c35-bc74-e62c03116ee7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:24.526532 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ac313a67-5749-4c35-bc74-e62c03116ee7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:24.541739 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ac313a67-5749-4c35-bc74-e62c03116ee7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1286 microversion: 2.1 time: 0.225813 Aug 31 11:43:24.560397 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 18/34] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:24 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1286 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:24.974878 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5d1983b4-eb63-414d-b454-5f12c93c0785 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:24.975843 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5d1983b4-eb63-414d-b454-5f12c93c0785 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:24.989737 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5d1983b4-eb63-414d-b454-5f12c93c0785 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:24.990635 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5d1983b4-eb63-414d-b454-5f12c93c0785 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:24.991303 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5d1983b4-eb63-414d-b454-5f12c93c0785 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:24.992223 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5d1983b4-eb63-414d-b454-5f12c93c0785 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:24.992908 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5d1983b4-eb63-414d-b454-5f12c93c0785 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:24.993684 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5d1983b4-eb63-414d-b454-5f12c93c0785 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:25.175713 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-777d0d23-b419-4cc6-bcdc-a7a5c26eba73 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:25.176871 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-777d0d23-b419-4cc6-bcdc-a7a5c26eba73 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:25.200854 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-777d0d23-b419-4cc6-bcdc-a7a5c26eba73 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:25.201314 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-777d0d23-b419-4cc6-bcdc-a7a5c26eba73 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:25.201757 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-777d0d23-b419-4cc6-bcdc-a7a5c26eba73 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:25.202463 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-777d0d23-b419-4cc6-bcdc-a7a5c26eba73 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:25.217701 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-777d0d23-b419-4cc6-bcdc-a7a5c26eba73 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:25.223259 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-777d0d23-b419-4cc6-bcdc-a7a5c26eba73 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:25.264068 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5d1983b4-eb63-414d-b454-5f12c93c0785 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:25.286205 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5d1983b4-eb63-414d-b454-5f12c93c0785 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:25.289051 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5d1983b4-eb63-414d-b454-5f12c93c0785 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:25.291299 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5d1983b4-eb63-414d-b454-5f12c93c0785 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1352 microversion: 2.20 time: 0.321270 Aug 31 11:43:25.293841 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 17/35] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:24 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1352 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:25.328970 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d5865841-3f0c-4701-8885-bff902248d40 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:25.329594 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d5865841-3f0c-4701-8885-bff902248d40 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:25.340638 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d5865841-3f0c-4701-8885-bff902248d40 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:25.341626 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d5865841-3f0c-4701-8885-bff902248d40 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:25.342158 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d5865841-3f0c-4701-8885-bff902248d40 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:25.342943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d5865841-3f0c-4701-8885-bff902248d40 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:25.343727 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d5865841-3f0c-4701-8885-bff902248d40 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:25.344279 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d5865841-3f0c-4701-8885-bff902248d40 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:25.372359 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-777d0d23-b419-4cc6-bcdc-a7a5c26eba73 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:25.390839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-777d0d23-b419-4cc6-bcdc-a7a5c26eba73 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1266 microversion: 2.1 time: 0.217195 Aug 31 11:43:25.391894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 19/36] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:25 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:25.410125 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f754a699-b762-42a2-9dcc-528976b90211 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:25.410975 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f754a699-b762-42a2-9dcc-528976b90211 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:25.430883 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f754a699-b762-42a2-9dcc-528976b90211 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:25.431529 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f754a699-b762-42a2-9dcc-528976b90211 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:25.442795 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f754a699-b762-42a2-9dcc-528976b90211 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:25.448782 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f754a699-b762-42a2-9dcc-528976b90211 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:25.451139 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f754a699-b762-42a2-9dcc-528976b90211 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:25.451627 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f754a699-b762-42a2-9dcc-528976b90211 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:25.492121 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d5865841-3f0c-4701-8885-bff902248d40 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:25.502640 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d5865841-3f0c-4701-8885-bff902248d40 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1292 microversion: 2.1 time: 0.177637 Aug 31 11:43:25.518163 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 18/37] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:25 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1292 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:25.583945 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0ec69158-7cb7-4859-96aa-faa0e5af02ce tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:25.585268 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0ec69158-7cb7-4859-96aa-faa0e5af02ce tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:25.597585 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0ec69158-7cb7-4859-96aa-faa0e5af02ce tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:25.598081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0ec69158-7cb7-4859-96aa-faa0e5af02ce tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:25.598512 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0ec69158-7cb7-4859-96aa-faa0e5af02ce tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:25.599212 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0ec69158-7cb7-4859-96aa-faa0e5af02ce tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:25.601131 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0ec69158-7cb7-4859-96aa-faa0e5af02ce tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:25.604220 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0ec69158-7cb7-4859-96aa-faa0e5af02ce tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:25.615066 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f754a699-b762-42a2-9dcc-528976b90211 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:25.623761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f754a699-b762-42a2-9dcc-528976b90211 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1273 microversion: 2.1 time: 0.228038 Aug 31 11:43:25.642823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 20/38] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:25 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1273 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:25.727288 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0ec69158-7cb7-4859-96aa-faa0e5af02ce tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:25.741376 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0ec69158-7cb7-4859-96aa-faa0e5af02ce tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1286 microversion: 2.1 time: 0.163104 Aug 31 11:43:25.745684 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 19/39] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:25 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1286 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:26.319165 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d2f47901-edb7-4e3b-a7e0-29b3f6f672a8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:26.319832 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d2f47901-edb7-4e3b-a7e0-29b3f6f672a8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:26.329879 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d2f47901-edb7-4e3b-a7e0-29b3f6f672a8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:26.330389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d2f47901-edb7-4e3b-a7e0-29b3f6f672a8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:26.332249 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d2f47901-edb7-4e3b-a7e0-29b3f6f672a8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:26.333212 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d2f47901-edb7-4e3b-a7e0-29b3f6f672a8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:26.334125 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d2f47901-edb7-4e3b-a7e0-29b3f6f672a8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:26.334560 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d2f47901-edb7-4e3b-a7e0-29b3f6f672a8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:26.413890 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ecb0efa9-1f0b-4fb0-ab0b-ef4f0f341809 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:26.415426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ecb0efa9-1f0b-4fb0-ab0b-ef4f0f341809 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:26.442087 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ecb0efa9-1f0b-4fb0-ab0b-ef4f0f341809 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:26.442598 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ecb0efa9-1f0b-4fb0-ab0b-ef4f0f341809 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:26.443983 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ecb0efa9-1f0b-4fb0-ab0b-ef4f0f341809 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:26.444760 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ecb0efa9-1f0b-4fb0-ab0b-ef4f0f341809 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:26.453382 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ecb0efa9-1f0b-4fb0-ab0b-ef4f0f341809 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:26.453940 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ecb0efa9-1f0b-4fb0-ab0b-ef4f0f341809 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:26.459654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d2f47901-edb7-4e3b-a7e0-29b3f6f672a8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:26.481337 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d2f47901-edb7-4e3b-a7e0-29b3f6f672a8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:26.488287 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d2f47901-edb7-4e3b-a7e0-29b3f6f672a8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:26.492355 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d2f47901-edb7-4e3b-a7e0-29b3f6f672a8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1340 microversion: 2.20 time: 0.179042 Aug 31 11:43:26.495684 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:26 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1340 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:26.527779 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-29d8da4c-3290-4fd3-b889-93c2781bfd9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:26.528573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-29d8da4c-3290-4fd3-b889-93c2781bfd9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:26.555915 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29d8da4c-3290-4fd3-b889-93c2781bfd9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:26.558605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29d8da4c-3290-4fd3-b889-93c2781bfd9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:26.559277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29d8da4c-3290-4fd3-b889-93c2781bfd9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:26.562578 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29d8da4c-3290-4fd3-b889-93c2781bfd9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:26.563514 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29d8da4c-3290-4fd3-b889-93c2781bfd9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:26.564825 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29d8da4c-3290-4fd3-b889-93c2781bfd9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:26.660005 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ecb0efa9-1f0b-4fb0-ab0b-ef4f0f341809 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:26.673400 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ecb0efa9-1f0b-4fb0-ab0b-ef4f0f341809 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1266 microversion: 2.1 time: 0.264649 Aug 31 11:43:26.685374 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 20/41] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:26 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:26.691785 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9dee02e1-52dc-41f4-a742-6a91f8789c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:26.692828 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9dee02e1-52dc-41f4-a742-6a91f8789c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:26.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:26.703839 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9dee02e1-52dc-41f4-a742-6a91f8789c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:26.705078 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9dee02e1-52dc-41f4-a742-6a91f8789c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:26.706076 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9dee02e1-52dc-41f4-a742-6a91f8789c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:26.707308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9dee02e1-52dc-41f4-a742-6a91f8789c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:26.707949 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9dee02e1-52dc-41f4-a742-6a91f8789c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:26.708621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9dee02e1-52dc-41f4-a742-6a91f8789c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:27.030894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-29d8da4c-3290-4fd3-b889-93c2781bfd9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:27.039664 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-29d8da4c-3290-4fd3-b889-93c2781bfd9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1292 microversion: 2.1 time: 0.516414 Aug 31 11:43:27.051432 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 22/42] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:26 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1292 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:27.064819 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fa5c1603-26ff-4011-9866-132422680052 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:27.073012 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fa5c1603-26ff-4011-9866-132422680052 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:27.093986 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa5c1603-26ff-4011-9866-132422680052 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:27.099491 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa5c1603-26ff-4011-9866-132422680052 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:27.100170 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa5c1603-26ff-4011-9866-132422680052 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:27.101103 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa5c1603-26ff-4011-9866-132422680052 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:27.101728 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa5c1603-26ff-4011-9866-132422680052 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:27.102304 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa5c1603-26ff-4011-9866-132422680052 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:27.132774 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9dee02e1-52dc-41f4-a742-6a91f8789c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:27.146491 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9dee02e1-52dc-41f4-a742-6a91f8789c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1273 microversion: 2.1 time: 0.459677 Aug 31 11:43:27.151235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 21/43] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:26 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1273 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:27.523637 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1ca2ada9-13f5-4928-8df8-8ab796e062c7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:27.524254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1ca2ada9-13f5-4928-8df8-8ab796e062c7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:27.539834 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1ca2ada9-13f5-4928-8df8-8ab796e062c7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:27.540878 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1ca2ada9-13f5-4928-8df8-8ab796e062c7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:27.543104 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1ca2ada9-13f5-4928-8df8-8ab796e062c7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:27.545600 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1ca2ada9-13f5-4928-8df8-8ab796e062c7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:27.548686 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1ca2ada9-13f5-4928-8df8-8ab796e062c7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:27.549398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1ca2ada9-13f5-4928-8df8-8ab796e062c7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:27.918501 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1ca2ada9-13f5-4928-8df8-8ab796e062c7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:27.931110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1ca2ada9-13f5-4928-8df8-8ab796e062c7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:27.936148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1ca2ada9-13f5-4928-8df8-8ab796e062c7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:27.937066 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1ca2ada9-13f5-4928-8df8-8ab796e062c7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1340 microversion: 2.20 time: 0.418124 Aug 31 11:43:27.937618 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 22/44] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:27 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1340 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:43:27.959241 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-54f299e0-35cf-41b3-a3d6-1bd6f5d7e56b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:27.969777 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-54f299e0-35cf-41b3-a3d6-1bd6f5d7e56b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:28.021307 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-54f299e0-35cf-41b3-a3d6-1bd6f5d7e56b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:28.022516 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-54f299e0-35cf-41b3-a3d6-1bd6f5d7e56b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:28.024306 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-54f299e0-35cf-41b3-a3d6-1bd6f5d7e56b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:28.029053 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-54f299e0-35cf-41b3-a3d6-1bd6f5d7e56b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:28.030610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-54f299e0-35cf-41b3-a3d6-1bd6f5d7e56b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:28.033201 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-54f299e0-35cf-41b3-a3d6-1bd6f5d7e56b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:28.048271 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-fa5c1603-26ff-4011-9866-132422680052 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:28.059904 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-fa5c1603-26ff-4011-9866-132422680052 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1304 microversion: 2.1 time: 1.007295 Aug 31 11:43:28.071399 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 23/45] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:27 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1304 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:28.096413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2f955583-57f6-4025-b5f0-378d708265c8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:28.097541 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2f955583-57f6-4025-b5f0-378d708265c8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:28.100411 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:28.125198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f955583-57f6-4025-b5f0-378d708265c8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:28.126006 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f955583-57f6-4025-b5f0-378d708265c8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:28.131259 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f955583-57f6-4025-b5f0-378d708265c8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:28.132237 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f955583-57f6-4025-b5f0-378d708265c8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:28.132890 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f955583-57f6-4025-b5f0-378d708265c8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:28.133515 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f955583-57f6-4025-b5f0-378d708265c8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:28.470917 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2f955583-57f6-4025-b5f0-378d708265c8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:28.481291 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2f955583-57f6-4025-b5f0-378d708265c8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1298 microversion: 2.1 time: 0.406664 Aug 31 11:43:28.486650 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 24/46] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:28 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1298 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:28.495271 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3bca7a26-f5bd-489a-bfb5-e7aeeeccd407 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:28.512638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3bca7a26-f5bd-489a-bfb5-e7aeeeccd407 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:28.518950 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3bca7a26-f5bd-489a-bfb5-e7aeeeccd407 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:28.521125 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3bca7a26-f5bd-489a-bfb5-e7aeeeccd407 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:28.522320 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3bca7a26-f5bd-489a-bfb5-e7aeeeccd407 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:28.524443 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3bca7a26-f5bd-489a-bfb5-e7aeeeccd407 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:28.525162 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3bca7a26-f5bd-489a-bfb5-e7aeeeccd407 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:28.527671 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3bca7a26-f5bd-489a-bfb5-e7aeeeccd407 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:28.553882 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-54f299e0-35cf-41b3-a3d6-1bd6f5d7e56b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:28.566776 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-54f299e0-35cf-41b3-a3d6-1bd6f5d7e56b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1272 microversion: 2.1 time: 0.609300 Aug 31 11:43:28.567397 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 23/47] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:27 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1272 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:28.937705 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3bca7a26-f5bd-489a-bfb5-e7aeeeccd407 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:28.952675 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3bca7a26-f5bd-489a-bfb5-e7aeeeccd407 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1279 microversion: 2.1 time: 0.463635 Aug 31 11:43:28.961692 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 25/48] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:28 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1279 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:28.971995 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-fd2c5a07-46e2-403e-901b-3e4f33957aec tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:28.972654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-fd2c5a07-46e2-403e-901b-3e4f33957aec tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:28.991240 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd2c5a07-46e2-403e-901b-3e4f33957aec tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:28.993094 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd2c5a07-46e2-403e-901b-3e4f33957aec tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:28.996542 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd2c5a07-46e2-403e-901b-3e4f33957aec tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:29.005078 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd2c5a07-46e2-403e-901b-3e4f33957aec tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:29.005552 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd2c5a07-46e2-403e-901b-3e4f33957aec tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:29.005989 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd2c5a07-46e2-403e-901b-3e4f33957aec tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:29.087734 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9430d328-32db-4189-afc3-81cc3b2add37 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:29.089352 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9430d328-32db-4189-afc3-81cc3b2add37 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:29.096435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9430d328-32db-4189-afc3-81cc3b2add37 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:29.099875 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9430d328-32db-4189-afc3-81cc3b2add37 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:29.100894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9430d328-32db-4189-afc3-81cc3b2add37 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:29.101787 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9430d328-32db-4189-afc3-81cc3b2add37 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:29.102563 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9430d328-32db-4189-afc3-81cc3b2add37 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:29.103142 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9430d328-32db-4189-afc3-81cc3b2add37 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:29.276346 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9430d328-32db-4189-afc3-81cc3b2add37 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:29.288795 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9430d328-32db-4189-afc3-81cc3b2add37 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1292 microversion: 2.1 time: 0.206468 Aug 31 11:43:29.293259 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 26/49] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:29 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1292 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:29.436372 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-fd2c5a07-46e2-403e-901b-3e4f33957aec tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:29.448184 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-fd2c5a07-46e2-403e-901b-3e4f33957aec tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:29.452986 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-fd2c5a07-46e2-403e-901b-3e4f33957aec tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:29.458464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-fd2c5a07-46e2-403e-901b-3e4f33957aec tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1340 microversion: 2.20 time: 0.490237 Aug 31 11:43:29.461880 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 24/50] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:28 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1340 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:43:29.515370 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1a874192-f831-46ac-a35a-8c796d93dd78 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:29.516312 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1a874192-f831-46ac-a35a-8c796d93dd78 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:29.538047 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1a874192-f831-46ac-a35a-8c796d93dd78 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:29.538552 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1a874192-f831-46ac-a35a-8c796d93dd78 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:29.538993 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1a874192-f831-46ac-a35a-8c796d93dd78 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:29.539710 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1a874192-f831-46ac-a35a-8c796d93dd78 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:29.540166 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1a874192-f831-46ac-a35a-8c796d93dd78 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:29.540751 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1a874192-f831-46ac-a35a-8c796d93dd78 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:29.589323 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d62334de-f72b-452b-b885-869c516352f1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:29.590130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d62334de-f72b-452b-b885-869c516352f1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:29.602395 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d62334de-f72b-452b-b885-869c516352f1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:29.602888 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d62334de-f72b-452b-b885-869c516352f1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:29.606347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d62334de-f72b-452b-b885-869c516352f1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:29.607096 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d62334de-f72b-452b-b885-869c516352f1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:29.609063 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d62334de-f72b-452b-b885-869c516352f1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:29.609508 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d62334de-f72b-452b-b885-869c516352f1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:29.825723 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1a874192-f831-46ac-a35a-8c796d93dd78 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:29.835586 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1a874192-f831-46ac-a35a-8c796d93dd78 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1298 microversion: 2.1 time: 0.323993 Aug 31 11:43:29.844309 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 27/51] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:29 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1298 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:29.914490 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d62334de-f72b-452b-b885-869c516352f1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:29.939817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d62334de-f72b-452b-b885-869c516352f1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1272 microversion: 2.1 time: 0.354376 Aug 31 11:43:29.961317 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 25/52] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:29 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1272 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:29.989830 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5382b90d-6cb0-4302-b794-c775de0a0598 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:29.990702 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5382b90d-6cb0-4302-b794-c775de0a0598 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:30.002507 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5382b90d-6cb0-4302-b794-c775de0a0598 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:30.003873 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5382b90d-6cb0-4302-b794-c775de0a0598 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:30.004311 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5382b90d-6cb0-4302-b794-c775de0a0598 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:30.005500 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5382b90d-6cb0-4302-b794-c775de0a0598 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:30.005672 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5382b90d-6cb0-4302-b794-c775de0a0598 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:30.010598 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5382b90d-6cb0-4302-b794-c775de0a0598 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:30.314186 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-72d8e8bf-9a05-4610-86c5-92db0a52d2fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:30.315050 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-72d8e8bf-9a05-4610-86c5-92db0a52d2fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:30.348206 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72d8e8bf-9a05-4610-86c5-92db0a52d2fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:30.351936 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72d8e8bf-9a05-4610-86c5-92db0a52d2fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:30.352606 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72d8e8bf-9a05-4610-86c5-92db0a52d2fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:30.353512 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72d8e8bf-9a05-4610-86c5-92db0a52d2fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:30.357460 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72d8e8bf-9a05-4610-86c5-92db0a52d2fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:30.358104 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72d8e8bf-9a05-4610-86c5-92db0a52d2fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:30.453413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5382b90d-6cb0-4302-b794-c775de0a0598 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:30.470335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5382b90d-6cb0-4302-b794-c775de0a0598 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1279 microversion: 2.1 time: 0.483325 Aug 31 11:43:30.497627 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 28/53] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:29 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1279 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:30.513578 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e837de84-66ad-4a12-8add-4614f3125bfc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:30.516297 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e837de84-66ad-4a12-8add-4614f3125bfc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:30.542462 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e837de84-66ad-4a12-8add-4614f3125bfc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:30.542965 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e837de84-66ad-4a12-8add-4614f3125bfc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:30.543401 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e837de84-66ad-4a12-8add-4614f3125bfc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:30.549756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e837de84-66ad-4a12-8add-4614f3125bfc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:30.550271 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e837de84-66ad-4a12-8add-4614f3125bfc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:30.550884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e837de84-66ad-4a12-8add-4614f3125bfc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:30.724117 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-72d8e8bf-9a05-4610-86c5-92db0a52d2fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:30.732141 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-72d8e8bf-9a05-4610-86c5-92db0a52d2fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1292 microversion: 2.1 time: 0.421732 Aug 31 11:43:30.732764 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 26/54] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:30 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1292 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:30.875810 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6abc2fee-2e01-43fc-bdaf-6195e62b34ff tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:30.877045 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6abc2fee-2e01-43fc-bdaf-6195e62b34ff tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:30.891116 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6abc2fee-2e01-43fc-bdaf-6195e62b34ff tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:30.891797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6abc2fee-2e01-43fc-bdaf-6195e62b34ff tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:30.892433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6abc2fee-2e01-43fc-bdaf-6195e62b34ff tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:30.895005 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6abc2fee-2e01-43fc-bdaf-6195e62b34ff tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:30.896105 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6abc2fee-2e01-43fc-bdaf-6195e62b34ff tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:30.897157 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6abc2fee-2e01-43fc-bdaf-6195e62b34ff tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:30.957508 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:31.570563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6abc2fee-2e01-43fc-bdaf-6195e62b34ff tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:31.585963 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6abc2fee-2e01-43fc-bdaf-6195e62b34ff tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1298 microversion: 2.1 time: 0.714788 Aug 31 11:43:31.598725 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 27/55] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:30 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1298 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:31.610800 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-769e83d9-6761-456d-b09a-ee16d0db3938 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:31.615815 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-769e83d9-6761-456d-b09a-ee16d0db3938 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:31.626502 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-769e83d9-6761-456d-b09a-ee16d0db3938 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:31.627247 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-769e83d9-6761-456d-b09a-ee16d0db3938 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:31.632842 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-769e83d9-6761-456d-b09a-ee16d0db3938 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:31.633656 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-769e83d9-6761-456d-b09a-ee16d0db3938 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:31.634127 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-769e83d9-6761-456d-b09a-ee16d0db3938 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:31.634556 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-769e83d9-6761-456d-b09a-ee16d0db3938 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:31.937608 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-769e83d9-6761-456d-b09a-ee16d0db3938 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:31.950446 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-769e83d9-6761-456d-b09a-ee16d0db3938 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1272 microversion: 2.1 time: 0.347731 Aug 31 11:43:31.966228 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 28/56] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:31 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1272 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:31.992543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d6f4a77b-b116-4e16-a902-0fea57c748b3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:31.994228 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d6f4a77b-b116-4e16-a902-0fea57c748b3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:32.014087 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6f4a77b-b116-4e16-a902-0fea57c748b3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:32.018514 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6f4a77b-b116-4e16-a902-0fea57c748b3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:32.019268 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6f4a77b-b116-4e16-a902-0fea57c748b3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:32.020174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6f4a77b-b116-4e16-a902-0fea57c748b3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:32.023581 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6f4a77b-b116-4e16-a902-0fea57c748b3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:32.024322 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6f4a77b-b116-4e16-a902-0fea57c748b3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:32.091628 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=6 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:32.136252 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=28 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:32.142669 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e837de84-66ad-4a12-8add-4614f3125bfc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:32.169553 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e837de84-66ad-4a12-8add-4614f3125bfc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:32.171494 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e837de84-66ad-4a12-8add-4614f3125bfc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:32.177261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e837de84-66ad-4a12-8add-4614f3125bfc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 1.677443 Aug 31 11:43:32.195884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 29/57] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:30 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:32.204113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9aca368f-f7f4-41f8-8499-f28cb5171fee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:32.208472 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9aca368f-f7f4-41f8-8499-f28cb5171fee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:32.216747 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9aca368f-f7f4-41f8-8499-f28cb5171fee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:32.219058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9aca368f-f7f4-41f8-8499-f28cb5171fee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:32.219732 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9aca368f-f7f4-41f8-8499-f28cb5171fee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:32.220791 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9aca368f-f7f4-41f8-8499-f28cb5171fee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:32.223429 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9aca368f-f7f4-41f8-8499-f28cb5171fee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:32.224310 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9aca368f-f7f4-41f8-8499-f28cb5171fee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:32.548528 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=6 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:32.891197 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d6f4a77b-b116-4e16-a902-0fea57c748b3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:32.909828 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d6f4a77b-b116-4e16-a902-0fea57c748b3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.936637 Aug 31 11:43:32.933936 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 29/58] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:31 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:32.943900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-91ae4321-dbdf-4030-908b-e4c0a65c5b52 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:32.945353 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-91ae4321-dbdf-4030-908b-e4c0a65c5b52 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:32.954015 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-91ae4321-dbdf-4030-908b-e4c0a65c5b52 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:32.954933 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-91ae4321-dbdf-4030-908b-e4c0a65c5b52 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:32.955752 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-91ae4321-dbdf-4030-908b-e4c0a65c5b52 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:32.963927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-91ae4321-dbdf-4030-908b-e4c0a65c5b52 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:32.965186 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-91ae4321-dbdf-4030-908b-e4c0a65c5b52 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:32.965925 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-91ae4321-dbdf-4030-908b-e4c0a65c5b52 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:33.072600 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=28 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:33.207781 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9aca368f-f7f4-41f8-8499-f28cb5171fee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:33.217427 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9aca368f-f7f4-41f8-8499-f28cb5171fee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 1.020043 Aug 31 11:43:33.223836 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 30/59] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:32 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:33.249748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0810d912-e5a0-433a-95c1-59108cb9ab63 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:33.250794 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-0810d912-e5a0-433a-95c1-59108cb9ab63 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:33.261370 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0810d912-e5a0-433a-95c1-59108cb9ab63 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:33.263252 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0810d912-e5a0-433a-95c1-59108cb9ab63 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:33.265030 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0810d912-e5a0-433a-95c1-59108cb9ab63 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:33.266225 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0810d912-e5a0-433a-95c1-59108cb9ab63 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:33.267086 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0810d912-e5a0-433a-95c1-59108cb9ab63 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:33.268154 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0810d912-e5a0-433a-95c1-59108cb9ab63 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:33.363638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:33.757793 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-91ae4321-dbdf-4030-908b-e4c0a65c5b52 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:33.767376 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-91ae4321-dbdf-4030-908b-e4c0a65c5b52 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.831638 Aug 31 11:43:33.785369 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 30/60] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:32 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:33.785369 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4889e948-6929-410b-9244-76cde298c9b6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:33.785369 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4889e948-6929-410b-9244-76cde298c9b6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:33.807018 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4889e948-6929-410b-9244-76cde298c9b6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:33.807997 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4889e948-6929-410b-9244-76cde298c9b6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:33.808524 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4889e948-6929-410b-9244-76cde298c9b6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:33.810450 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4889e948-6929-410b-9244-76cde298c9b6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:33.810914 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4889e948-6929-410b-9244-76cde298c9b6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:33.817968 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4889e948-6929-410b-9244-76cde298c9b6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:33.838162 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0810d912-e5a0-433a-95c1-59108cb9ab63 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:33.848809 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0810d912-e5a0-433a-95c1-59108cb9ab63 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.623628 Aug 31 11:43:33.865357 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 31/61] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:33 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:33.936740 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-721cb18d-e37f-4518-989b-203eaf5d4388 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:33.937411 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-721cb18d-e37f-4518-989b-203eaf5d4388 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:33.948467 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-721cb18d-e37f-4518-989b-203eaf5d4388 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:33.948978 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-721cb18d-e37f-4518-989b-203eaf5d4388 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:33.951921 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-721cb18d-e37f-4518-989b-203eaf5d4388 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:33.953019 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-721cb18d-e37f-4518-989b-203eaf5d4388 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:33.953672 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-721cb18d-e37f-4518-989b-203eaf5d4388 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:33.954873 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-721cb18d-e37f-4518-989b-203eaf5d4388 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:34.031793 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4889e948-6929-410b-9244-76cde298c9b6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:34.047377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4889e948-6929-410b-9244-76cde298c9b6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:34.050654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4889e948-6929-410b-9244-76cde298c9b6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:34.052169 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4889e948-6929-410b-9244-76cde298c9b6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.276062 Aug 31 11:43:34.052986 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 31/62] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:33 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:34.218745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-721cb18d-e37f-4518-989b-203eaf5d4388 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:34.233166 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-721cb18d-e37f-4518-989b-203eaf5d4388 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.295603 Aug 31 11:43:34.233166 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 32/63] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:33 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:34.244875 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0f36e799-0c6b-4c40-aced-9f14d35e44b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:34.246241 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-0f36e799-0c6b-4c40-aced-9f14d35e44b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:34.252434 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0f36e799-0c6b-4c40-aced-9f14d35e44b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:34.253791 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0f36e799-0c6b-4c40-aced-9f14d35e44b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:34.254386 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0f36e799-0c6b-4c40-aced-9f14d35e44b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:34.255098 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0f36e799-0c6b-4c40-aced-9f14d35e44b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:34.255548 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0f36e799-0c6b-4c40-aced-9f14d35e44b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:34.255969 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0f36e799-0c6b-4c40-aced-9f14d35e44b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:34.346204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-4ed6967e-5a32-45d1-9ca3-659ce9a3a3b5 req-5dd1ff53-c582-4ea7-b284-e16102b666e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06215e54-27bb-4685-9a34-14109d73c81e", "tag": "c4e2bf04-c687-4686-9210-e0be89d06923"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:43:34.360718 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-4ed6967e-5a32-45d1-9ca3-659ce9a3a3b5 req-5dd1ff53-c582-4ea7-b284-e16102b666e8 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:34.361384 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-4ed6967e-5a32-45d1-9ca3-659ce9a3a3b5 req-5dd1ff53-c582-4ea7-b284-e16102b666e8 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:34.362530 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-4ed6967e-5a32-45d1-9ca3-659ce9a3a3b5 req-5dd1ff53-c582-4ea7-b284-e16102b666e8 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:34.385104 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-4ed6967e-5a32-45d1-9ca3-659ce9a3a3b5 req-5dd1ff53-c582-4ea7-b284-e16102b666e8 service nova] Creating event network-changed:c4e2bf04-c687-4686-9210-e0be89d06923 for instance 06215e54-27bb-4685-9a34-14109d73c81e on hv-cinder-83976 Aug 31 11:43:34.385719 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-4ed6967e-5a32-45d1-9ca3-659ce9a3a3b5 req-5dd1ff53-c582-4ea7-b284-e16102b666e8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127062) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 11:43:34.386187 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-4ed6967e-5a32-45d1-9ca3-659ce9a3a3b5 req-5dd1ff53-c582-4ea7-b284-e16102b666e8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127062) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 11:43:34.387417 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a99e93c-da6c-4e74-b1da-d0de8482f5f8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:34.387935 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a99e93c-da6c-4e74-b1da-d0de8482f5f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:34.388578 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a99e93c-da6c-4e74-b1da-d0de8482f5f8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:34.389439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a99e93c-da6c-4e74-b1da-d0de8482f5f8 None None] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:34.390530 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a99e93c-da6c-4e74-b1da-d0de8482f5f8 None None] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:34.390953 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a99e93c-da6c-4e74-b1da-d0de8482f5f8 None None] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:34.399803 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.compute.rpcapi [None req-0a99e93c-da6c-4e74-b1da-d0de8482f5f8 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 11:43:34.400299 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0f36e799-0c6b-4c40-aced-9f14d35e44b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:34.400712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a99e93c-da6c-4e74-b1da-d0de8482f5f8 None None] Releasing lock "compute-rpcapi-router" {{(pid=127062) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 11:43:34.409628 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0f36e799-0c6b-4c40-aced-9f14d35e44b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.169485 Aug 31 11:43:34.410532 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 33/64] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:34 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:34.422766 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0a99e93c-da6c-4e74-b1da-d0de8482f5f8 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221337 Aug 31 11:43:34.422766 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 32/65] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:43:34.797363 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3a991a25-9e3c-4594-af4f-35e30fbf7c0e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:34.798107 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3a991a25-9e3c-4594-af4f-35e30fbf7c0e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:34.804683 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a991a25-9e3c-4594-af4f-35e30fbf7c0e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:34.805152 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a991a25-9e3c-4594-af4f-35e30fbf7c0e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:34.805558 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a991a25-9e3c-4594-af4f-35e30fbf7c0e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:34.806252 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a991a25-9e3c-4594-af4f-35e30fbf7c0e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:34.806689 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a991a25-9e3c-4594-af4f-35e30fbf7c0e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:34.807101 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a991a25-9e3c-4594-af4f-35e30fbf7c0e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:34.870878 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1f086276-fa61-4635-8368-c919899b4773 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:34.871953 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1f086276-fa61-4635-8368-c919899b4773 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:34.878853 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1f086276-fa61-4635-8368-c919899b4773 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:34.879337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1f086276-fa61-4635-8368-c919899b4773 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:34.879882 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1f086276-fa61-4635-8368-c919899b4773 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:34.880672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1f086276-fa61-4635-8368-c919899b4773 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:34.881120 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1f086276-fa61-4635-8368-c919899b4773 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:34.881838 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1f086276-fa61-4635-8368-c919899b4773 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:34.969339 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3a991a25-9e3c-4594-af4f-35e30fbf7c0e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:34.989443 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3a991a25-9e3c-4594-af4f-35e30fbf7c0e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.195781 Aug 31 11:43:34.990026 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 34/66] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:34 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:35.059061 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1f086276-fa61-4635-8368-c919899b4773 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:35.067063 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1f086276-fa61-4635-8368-c919899b4773 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.200787 Aug 31 11:43:35.067866 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 33/67] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:34 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:35.077625 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-094dbbf5-c080-434c-b82c-e2ad75f6bcc5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:35.078248 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-094dbbf5-c080-434c-b82c-e2ad75f6bcc5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:35.084999 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-094dbbf5-c080-434c-b82c-e2ad75f6bcc5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:35.085648 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-094dbbf5-c080-434c-b82c-e2ad75f6bcc5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:35.086080 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-094dbbf5-c080-434c-b82c-e2ad75f6bcc5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:35.086762 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-094dbbf5-c080-434c-b82c-e2ad75f6bcc5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:35.087213 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-094dbbf5-c080-434c-b82c-e2ad75f6bcc5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:35.087636 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-094dbbf5-c080-434c-b82c-e2ad75f6bcc5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:35.218421 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-094dbbf5-c080-434c-b82c-e2ad75f6bcc5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:35.227305 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-094dbbf5-c080-434c-b82c-e2ad75f6bcc5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:35.228843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-094dbbf5-c080-434c-b82c-e2ad75f6bcc5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:35.229939 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-094dbbf5-c080-434c-b82c-e2ad75f6bcc5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.156228 Aug 31 11:43:35.230498 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:35 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:35.250004 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ec09b2bd-140e-4dd3-8323-7e81f212453d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:35.250632 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ec09b2bd-140e-4dd3-8323-7e81f212453d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:35.257389 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ec09b2bd-140e-4dd3-8323-7e81f212453d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:35.257872 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ec09b2bd-140e-4dd3-8323-7e81f212453d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:35.258306 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ec09b2bd-140e-4dd3-8323-7e81f212453d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:35.258989 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ec09b2bd-140e-4dd3-8323-7e81f212453d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:35.259440 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ec09b2bd-140e-4dd3-8323-7e81f212453d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:35.259863 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ec09b2bd-140e-4dd3-8323-7e81f212453d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:35.389704 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ec09b2bd-140e-4dd3-8323-7e81f212453d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:35.397975 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ec09b2bd-140e-4dd3-8323-7e81f212453d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.151825 Aug 31 11:43:35.398538 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 34/69] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:35 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:35.430691 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b20adb3a-e3f2-419d-9ff6-ad7ec5c60ab5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:35.431414 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b20adb3a-e3f2-419d-9ff6-ad7ec5c60ab5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:35.437824 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b20adb3a-e3f2-419d-9ff6-ad7ec5c60ab5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:35.438309 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b20adb3a-e3f2-419d-9ff6-ad7ec5c60ab5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:35.438742 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b20adb3a-e3f2-419d-9ff6-ad7ec5c60ab5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:35.439433 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b20adb3a-e3f2-419d-9ff6-ad7ec5c60ab5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:35.439883 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b20adb3a-e3f2-419d-9ff6-ad7ec5c60ab5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:35.441112 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b20adb3a-e3f2-419d-9ff6-ad7ec5c60ab5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:35.581579 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b20adb3a-e3f2-419d-9ff6-ad7ec5c60ab5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:35.590333 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b20adb3a-e3f2-419d-9ff6-ad7ec5c60ab5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.163232 Aug 31 11:43:35.591118 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 36/70] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:35 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:36.009319 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ba5e5833-1e07-472d-8588-67ba2ac85592 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:36.010186 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ba5e5833-1e07-472d-8588-67ba2ac85592 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:36.016995 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ba5e5833-1e07-472d-8588-67ba2ac85592 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:36.017474 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ba5e5833-1e07-472d-8588-67ba2ac85592 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:36.017895 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ba5e5833-1e07-472d-8588-67ba2ac85592 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:36.018618 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ba5e5833-1e07-472d-8588-67ba2ac85592 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:36.019057 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ba5e5833-1e07-472d-8588-67ba2ac85592 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:36.019667 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ba5e5833-1e07-472d-8588-67ba2ac85592 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:36.087693 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-db7c33b3-430f-4efa-910f-aa9423a3f86b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:36.088610 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-db7c33b3-430f-4efa-910f-aa9423a3f86b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:36.095036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-db7c33b3-430f-4efa-910f-aa9423a3f86b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:36.095547 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-db7c33b3-430f-4efa-910f-aa9423a3f86b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:36.095981 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-db7c33b3-430f-4efa-910f-aa9423a3f86b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:36.097413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-db7c33b3-430f-4efa-910f-aa9423a3f86b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:36.098075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-db7c33b3-430f-4efa-910f-aa9423a3f86b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:36.098504 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-db7c33b3-430f-4efa-910f-aa9423a3f86b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:36.174975 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ba5e5833-1e07-472d-8588-67ba2ac85592 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:36.186511 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ba5e5833-1e07-472d-8588-67ba2ac85592 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.180917 Aug 31 11:43:36.188791 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 35/71] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:36 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:36.253157 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e710ef23-b6d9-40cd-be86-e5d00332f056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:36.254314 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e710ef23-b6d9-40cd-be86-e5d00332f056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:36.261395 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e710ef23-b6d9-40cd-be86-e5d00332f056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:36.262154 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e710ef23-b6d9-40cd-be86-e5d00332f056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:36.262548 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-db7c33b3-430f-4efa-910f-aa9423a3f86b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:36.263134 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e710ef23-b6d9-40cd-be86-e5d00332f056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:36.263547 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e710ef23-b6d9-40cd-be86-e5d00332f056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:36.264340 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e710ef23-b6d9-40cd-be86-e5d00332f056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:36.264955 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e710ef23-b6d9-40cd-be86-e5d00332f056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:36.273696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-db7c33b3-430f-4efa-910f-aa9423a3f86b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.189976 Aug 31 11:43:36.274425 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 37/72] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:36 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:36.403963 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e710ef23-b6d9-40cd-be86-e5d00332f056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:36.414668 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e710ef23-b6d9-40cd-be86-e5d00332f056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:36.416284 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e710ef23-b6d9-40cd-be86-e5d00332f056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:36.417664 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e710ef23-b6d9-40cd-be86-e5d00332f056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.169224 Aug 31 11:43:36.418350 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 36/73] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:36 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:36.418515 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2359003e-aeb7-4d92-887b-de9746db9b14 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:36.419386 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2359003e-aeb7-4d92-887b-de9746db9b14 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:36.426151 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2359003e-aeb7-4d92-887b-de9746db9b14 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:36.426632 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2359003e-aeb7-4d92-887b-de9746db9b14 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:36.427063 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2359003e-aeb7-4d92-887b-de9746db9b14 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:36.427754 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2359003e-aeb7-4d92-887b-de9746db9b14 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:36.428199 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2359003e-aeb7-4d92-887b-de9746db9b14 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:36.428723 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2359003e-aeb7-4d92-887b-de9746db9b14 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:36.568003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2359003e-aeb7-4d92-887b-de9746db9b14 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:36.580642 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2359003e-aeb7-4d92-887b-de9746db9b14 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.165270 Aug 31 11:43:36.582244 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 38/74] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:36 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:36.613045 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2ba8f0e0-2e4e-459a-8202-1c3f793f5e2a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:36.613761 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2ba8f0e0-2e4e-459a-8202-1c3f793f5e2a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:36.620081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ba8f0e0-2e4e-459a-8202-1c3f793f5e2a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:36.621051 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ba8f0e0-2e4e-459a-8202-1c3f793f5e2a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:36.621978 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ba8f0e0-2e4e-459a-8202-1c3f793f5e2a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:36.622916 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ba8f0e0-2e4e-459a-8202-1c3f793f5e2a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:36.623661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ba8f0e0-2e4e-459a-8202-1c3f793f5e2a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:36.624256 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ba8f0e0-2e4e-459a-8202-1c3f793f5e2a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:36.825394 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2ba8f0e0-2e4e-459a-8202-1c3f793f5e2a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:36.839986 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2ba8f0e0-2e4e-459a-8202-1c3f793f5e2a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.232292 Aug 31 11:43:36.841053 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 37/75] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:36 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:37.211071 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-532c709a-307f-41d2-802c-b38bf395b410 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:37.212170 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-532c709a-307f-41d2-802c-b38bf395b410 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:37.225968 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-532c709a-307f-41d2-802c-b38bf395b410 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:37.229970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-532c709a-307f-41d2-802c-b38bf395b410 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:37.231414 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-532c709a-307f-41d2-802c-b38bf395b410 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:37.232844 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-532c709a-307f-41d2-802c-b38bf395b410 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:37.233578 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-532c709a-307f-41d2-802c-b38bf395b410 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:37.234253 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-532c709a-307f-41d2-802c-b38bf395b410 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:37.295269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d1894d47-7ad3-47da-b69e-2cca302e8d2a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:37.296236 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d1894d47-7ad3-47da-b69e-2cca302e8d2a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:37.309106 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d1894d47-7ad3-47da-b69e-2cca302e8d2a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:37.310491 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d1894d47-7ad3-47da-b69e-2cca302e8d2a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:37.314783 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d1894d47-7ad3-47da-b69e-2cca302e8d2a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:37.317685 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d1894d47-7ad3-47da-b69e-2cca302e8d2a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:37.318675 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d1894d47-7ad3-47da-b69e-2cca302e8d2a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:37.321187 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d1894d47-7ad3-47da-b69e-2cca302e8d2a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:37.482164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-532c709a-307f-41d2-802c-b38bf395b410 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:37.497146 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-532c709a-307f-41d2-802c-b38bf395b410 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.290878 Aug 31 11:43:37.498146 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 39/76] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:37 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:37.503631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8cc4ab32-6109-4c98-8185-e81f602f5fa6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:37.504399 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8cc4ab32-6109-4c98-8185-e81f602f5fa6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:37.522493 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8cc4ab32-6109-4c98-8185-e81f602f5fa6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:37.523197 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8cc4ab32-6109-4c98-8185-e81f602f5fa6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:37.526163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8cc4ab32-6109-4c98-8185-e81f602f5fa6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:37.529299 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8cc4ab32-6109-4c98-8185-e81f602f5fa6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:37.529964 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8cc4ab32-6109-4c98-8185-e81f602f5fa6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:37.530511 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8cc4ab32-6109-4c98-8185-e81f602f5fa6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:37.573412 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d1894d47-7ad3-47da-b69e-2cca302e8d2a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:37.584596 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d1894d47-7ad3-47da-b69e-2cca302e8d2a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.293226 Aug 31 11:43:37.585190 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 38/77] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:37 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:37.622381 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d966120c-3581-40f8-817d-635046f5002c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:37.627359 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d966120c-3581-40f8-817d-635046f5002c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:37.639018 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d966120c-3581-40f8-817d-635046f5002c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:37.641107 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d966120c-3581-40f8-817d-635046f5002c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:37.643158 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d966120c-3581-40f8-817d-635046f5002c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:37.644207 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d966120c-3581-40f8-817d-635046f5002c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:37.645448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d966120c-3581-40f8-817d-635046f5002c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:37.648233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d966120c-3581-40f8-817d-635046f5002c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:37.789772 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8cc4ab32-6109-4c98-8185-e81f602f5fa6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:37.800458 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8cc4ab32-6109-4c98-8185-e81f602f5fa6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:37.801945 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8cc4ab32-6109-4c98-8185-e81f602f5fa6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:37.803074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8cc4ab32-6109-4c98-8185-e81f602f5fa6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.303903 Aug 31 11:43:37.817011 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 40/78] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:37 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:37.862067 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7de53bd8-621f-4e99-8920-571d636d1948 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:37.862778 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7de53bd8-621f-4e99-8920-571d636d1948 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:37.869377 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7de53bd8-621f-4e99-8920-571d636d1948 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:37.870497 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7de53bd8-621f-4e99-8920-571d636d1948 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:37.871335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7de53bd8-621f-4e99-8920-571d636d1948 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:37.872184 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7de53bd8-621f-4e99-8920-571d636d1948 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:37.873056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7de53bd8-621f-4e99-8920-571d636d1948 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:37.873628 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7de53bd8-621f-4e99-8920-571d636d1948 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:37.878290 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d966120c-3581-40f8-817d-635046f5002c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:37.886446 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d966120c-3581-40f8-817d-635046f5002c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.271298 Aug 31 11:43:37.890146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 39/79] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:37 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:38.046384 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7de53bd8-621f-4e99-8920-571d636d1948 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:38.057986 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7de53bd8-621f-4e99-8920-571d636d1948 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.200028 Aug 31 11:43:38.058942 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 41/80] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:37 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:38.518372 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c41420df-2caa-4db2-95a3-ee4a2a4bb982 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:38.519531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c41420df-2caa-4db2-95a3-ee4a2a4bb982 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:38.525055 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c41420df-2caa-4db2-95a3-ee4a2a4bb982 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:38.525536 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c41420df-2caa-4db2-95a3-ee4a2a4bb982 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:38.525963 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c41420df-2caa-4db2-95a3-ee4a2a4bb982 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:38.526643 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c41420df-2caa-4db2-95a3-ee4a2a4bb982 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:38.527088 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c41420df-2caa-4db2-95a3-ee4a2a4bb982 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:38.527508 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c41420df-2caa-4db2-95a3-ee4a2a4bb982 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:38.608732 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e4747ea9-986f-4d69-8143-7df601a85396 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:38.610204 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e4747ea9-986f-4d69-8143-7df601a85396 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:38.634441 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e4747ea9-986f-4d69-8143-7df601a85396 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:38.635044 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e4747ea9-986f-4d69-8143-7df601a85396 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:38.635548 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e4747ea9-986f-4d69-8143-7df601a85396 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:38.639337 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e4747ea9-986f-4d69-8143-7df601a85396 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:38.639795 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e4747ea9-986f-4d69-8143-7df601a85396 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:38.640232 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e4747ea9-986f-4d69-8143-7df601a85396 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:38.736287 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c41420df-2caa-4db2-95a3-ee4a2a4bb982 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:38.748081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c41420df-2caa-4db2-95a3-ee4a2a4bb982 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.233471 Aug 31 11:43:38.749767 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 40/81] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:38 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:38.826195 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b3f43ae1-99f5-4314-952c-93efe6d6fcc8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:38.826891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b3f43ae1-99f5-4314-952c-93efe6d6fcc8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:38.836221 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3f43ae1-99f5-4314-952c-93efe6d6fcc8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:38.837268 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3f43ae1-99f5-4314-952c-93efe6d6fcc8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:38.838020 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3f43ae1-99f5-4314-952c-93efe6d6fcc8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:38.839002 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3f43ae1-99f5-4314-952c-93efe6d6fcc8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:38.839722 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3f43ae1-99f5-4314-952c-93efe6d6fcc8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:38.840350 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3f43ae1-99f5-4314-952c-93efe6d6fcc8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:38.884305 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e4747ea9-986f-4d69-8143-7df601a85396 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:38.895733 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e4747ea9-986f-4d69-8143-7df601a85396 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.290790 Aug 31 11:43:38.905990 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 42/82] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:38 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:38.915066 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ef763f6d-8b1a-4ad1-be4b-cf8f4ea1cdb7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:38.915779 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ef763f6d-8b1a-4ad1-be4b-cf8f4ea1cdb7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:38.943542 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ef763f6d-8b1a-4ad1-be4b-cf8f4ea1cdb7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:38.943542 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ef763f6d-8b1a-4ad1-be4b-cf8f4ea1cdb7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:38.944566 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ef763f6d-8b1a-4ad1-be4b-cf8f4ea1cdb7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:38.954709 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ef763f6d-8b1a-4ad1-be4b-cf8f4ea1cdb7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:38.955381 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ef763f6d-8b1a-4ad1-be4b-cf8f4ea1cdb7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:38.961683 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ef763f6d-8b1a-4ad1-be4b-cf8f4ea1cdb7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:39.204470 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b3f43ae1-99f5-4314-952c-93efe6d6fcc8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:39.216425 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b3f43ae1-99f5-4314-952c-93efe6d6fcc8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:39.218294 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b3f43ae1-99f5-4314-952c-93efe6d6fcc8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:39.219561 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b3f43ae1-99f5-4314-952c-93efe6d6fcc8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.397535 Aug 31 11:43:39.233017 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 41/83] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:38 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:43:39.241769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6e828051-53e0-47a8-9699-be4e75cc0de6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:39.242593 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6e828051-53e0-47a8-9699-be4e75cc0de6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:39.250577 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e828051-53e0-47a8-9699-be4e75cc0de6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:39.251383 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e828051-53e0-47a8-9699-be4e75cc0de6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:39.252141 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e828051-53e0-47a8-9699-be4e75cc0de6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:39.260852 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e828051-53e0-47a8-9699-be4e75cc0de6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:39.261964 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e828051-53e0-47a8-9699-be4e75cc0de6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:39.262623 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e828051-53e0-47a8-9699-be4e75cc0de6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:39.286383 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ef763f6d-8b1a-4ad1-be4b-cf8f4ea1cdb7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:39.296145 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ef763f6d-8b1a-4ad1-be4b-cf8f4ea1cdb7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.388430 Aug 31 11:43:39.297314 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 43/84] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:38 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:39.441064 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6e828051-53e0-47a8-9699-be4e75cc0de6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:39.451895 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6e828051-53e0-47a8-9699-be4e75cc0de6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.217355 Aug 31 11:43:39.457890 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 42/85] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:39 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:39.772735 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-452ec54c-35b9-476f-9470-ed396e1a725a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:39.774653 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-452ec54c-35b9-476f-9470-ed396e1a725a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:39.782514 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-452ec54c-35b9-476f-9470-ed396e1a725a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:39.783408 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-452ec54c-35b9-476f-9470-ed396e1a725a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:39.784881 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-452ec54c-35b9-476f-9470-ed396e1a725a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:39.785872 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-452ec54c-35b9-476f-9470-ed396e1a725a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:39.786551 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-452ec54c-35b9-476f-9470-ed396e1a725a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:39.787188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-452ec54c-35b9-476f-9470-ed396e1a725a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:39.920133 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2529da11-a566-4c35-aa6d-797e67f3f73d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:39.921721 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2529da11-a566-4c35-aa6d-797e67f3f73d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:39.941472 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2529da11-a566-4c35-aa6d-797e67f3f73d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:39.942042 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2529da11-a566-4c35-aa6d-797e67f3f73d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:39.942495 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2529da11-a566-4c35-aa6d-797e67f3f73d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:39.943221 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2529da11-a566-4c35-aa6d-797e67f3f73d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:39.943674 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2529da11-a566-4c35-aa6d-797e67f3f73d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:39.944099 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2529da11-a566-4c35-aa6d-797e67f3f73d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:40.017487 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-452ec54c-35b9-476f-9470-ed396e1a725a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:40.026474 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-452ec54c-35b9-476f-9470-ed396e1a725a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.259116 Aug 31 11:43:40.027046 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 44/86] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:39 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:40.125915 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2529da11-a566-4c35-aa6d-797e67f3f73d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:40.137838 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2529da11-a566-4c35-aa6d-797e67f3f73d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.221623 Aug 31 11:43:40.138726 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 43/87] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:39 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:40.256836 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0ef0ed09-2565-4a80-a5cb-f763107b4276 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:40.256836 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-0ef0ed09-2565-4a80-a5cb-f763107b4276 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:40.262575 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0ef0ed09-2565-4a80-a5cb-f763107b4276 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:40.263183 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0ef0ed09-2565-4a80-a5cb-f763107b4276 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:40.263632 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0ef0ed09-2565-4a80-a5cb-f763107b4276 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:40.264366 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0ef0ed09-2565-4a80-a5cb-f763107b4276 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:40.266109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0ef0ed09-2565-4a80-a5cb-f763107b4276 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:40.267680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0ef0ed09-2565-4a80-a5cb-f763107b4276 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:40.322350 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-72bb808d-2306-4da0-9761-77ac5b5db067 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:40.322977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-72bb808d-2306-4da0-9761-77ac5b5db067 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:40.333752 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72bb808d-2306-4da0-9761-77ac5b5db067 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:40.334382 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72bb808d-2306-4da0-9761-77ac5b5db067 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:40.338846 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72bb808d-2306-4da0-9761-77ac5b5db067 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:40.341240 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72bb808d-2306-4da0-9761-77ac5b5db067 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:40.341775 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72bb808d-2306-4da0-9761-77ac5b5db067 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:40.342212 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72bb808d-2306-4da0-9761-77ac5b5db067 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:40.372377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:40.544032 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-72bb808d-2306-4da0-9761-77ac5b5db067 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:40.553513 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-72bb808d-2306-4da0-9761-77ac5b5db067 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.234787 Aug 31 11:43:40.554223 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 44/88] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:40 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:40.559091 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-43998a64-16bf-4f3f-8056-587444d52fc3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:40.560338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-43998a64-16bf-4f3f-8056-587444d52fc3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:40.574017 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43998a64-16bf-4f3f-8056-587444d52fc3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:40.574769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43998a64-16bf-4f3f-8056-587444d52fc3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:40.575274 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43998a64-16bf-4f3f-8056-587444d52fc3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:40.576045 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43998a64-16bf-4f3f-8056-587444d52fc3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:40.576616 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43998a64-16bf-4f3f-8056-587444d52fc3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:40.577578 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43998a64-16bf-4f3f-8056-587444d52fc3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:40.660202 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0ef0ed09-2565-4a80-a5cb-f763107b4276 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:40.679329 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0ef0ed09-2565-4a80-a5cb-f763107b4276 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:40.701048 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0ef0ed09-2565-4a80-a5cb-f763107b4276 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:40.704218 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0ef0ed09-2565-4a80-a5cb-f763107b4276 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.460839 Aug 31 11:43:40.707459 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 45/89] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:40 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:40.898883 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-43998a64-16bf-4f3f-8056-587444d52fc3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:40.912354 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-43998a64-16bf-4f3f-8056-587444d52fc3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.356734 Aug 31 11:43:40.915668 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 45/90] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:40 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:41.048772 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3435a772-fcc5-4b17-bfab-a92e474e7ff0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:41.050091 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3435a772-fcc5-4b17-bfab-a92e474e7ff0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:41.056239 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3435a772-fcc5-4b17-bfab-a92e474e7ff0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:41.056738 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3435a772-fcc5-4b17-bfab-a92e474e7ff0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:41.057455 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3435a772-fcc5-4b17-bfab-a92e474e7ff0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:41.058151 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3435a772-fcc5-4b17-bfab-a92e474e7ff0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:41.058595 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3435a772-fcc5-4b17-bfab-a92e474e7ff0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:41.059015 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3435a772-fcc5-4b17-bfab-a92e474e7ff0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:41.159749 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5e1369ff-7d72-4369-bb66-38ad38ab522c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:41.161144 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5e1369ff-7d72-4369-bb66-38ad38ab522c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:41.167528 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e1369ff-7d72-4369-bb66-38ad38ab522c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:41.168176 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e1369ff-7d72-4369-bb66-38ad38ab522c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:41.168632 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e1369ff-7d72-4369-bb66-38ad38ab522c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:41.169847 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e1369ff-7d72-4369-bb66-38ad38ab522c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:41.170441 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e1369ff-7d72-4369-bb66-38ad38ab522c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:41.171009 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e1369ff-7d72-4369-bb66-38ad38ab522c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:41.251193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3435a772-fcc5-4b17-bfab-a92e474e7ff0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:41.261398 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3435a772-fcc5-4b17-bfab-a92e474e7ff0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.216306 Aug 31 11:43:41.265185 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 46/91] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:41 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:41.341922 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5e1369ff-7d72-4369-bb66-38ad38ab522c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:41.350560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5e1369ff-7d72-4369-bb66-38ad38ab522c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.194916 Aug 31 11:43:41.352546 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 46/92] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:41 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:41.577545 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4f1c6169-ad98-4541-880e-82b5e2441564 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:41.578504 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4f1c6169-ad98-4541-880e-82b5e2441564 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:41.586667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f1c6169-ad98-4541-880e-82b5e2441564 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:41.587149 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f1c6169-ad98-4541-880e-82b5e2441564 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:41.587773 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f1c6169-ad98-4541-880e-82b5e2441564 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:41.588469 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f1c6169-ad98-4541-880e-82b5e2441564 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:41.588943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f1c6169-ad98-4541-880e-82b5e2441564 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:41.589359 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f1c6169-ad98-4541-880e-82b5e2441564 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:41.735658 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5f872f71-0e43-464a-866c-a0302ea65f14 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:41.736298 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5f872f71-0e43-464a-866c-a0302ea65f14 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:41.743780 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5f872f71-0e43-464a-866c-a0302ea65f14 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:41.744268 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5f872f71-0e43-464a-866c-a0302ea65f14 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:41.744731 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5f872f71-0e43-464a-866c-a0302ea65f14 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:41.745423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5f872f71-0e43-464a-866c-a0302ea65f14 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:41.745873 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5f872f71-0e43-464a-866c-a0302ea65f14 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:41.746296 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5f872f71-0e43-464a-866c-a0302ea65f14 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:41.765846 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4f1c6169-ad98-4541-880e-82b5e2441564 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:41.778235 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4f1c6169-ad98-4541-880e-82b5e2441564 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.206023 Aug 31 11:43:41.793674 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 47/93] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:41 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:41.926471 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5f872f71-0e43-464a-866c-a0302ea65f14 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:41.937229 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f35e302c-2078-4a16-951c-b5e483a820b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:41.938120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f35e302c-2078-4a16-951c-b5e483a820b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:41.952162 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f35e302c-2078-4a16-951c-b5e483a820b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:41.953259 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f35e302c-2078-4a16-951c-b5e483a820b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:41.953558 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5f872f71-0e43-464a-866c-a0302ea65f14 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:41.954746 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f35e302c-2078-4a16-951c-b5e483a820b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:41.956706 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f35e302c-2078-4a16-951c-b5e483a820b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:41.957953 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5f872f71-0e43-464a-866c-a0302ea65f14 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:41.958793 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f35e302c-2078-4a16-951c-b5e483a820b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:41.960439 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f35e302c-2078-4a16-951c-b5e483a820b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:41.962280 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5f872f71-0e43-464a-866c-a0302ea65f14 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.231826 Aug 31 11:43:41.965169 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 47/94] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:41 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:43:41.981736 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:42.288592 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2d7566a5-553e-4d72-b58e-1645f8d15925 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:42.289134 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2d7566a5-553e-4d72-b58e-1645f8d15925 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:42.298288 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d7566a5-553e-4d72-b58e-1645f8d15925 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:42.298779 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d7566a5-553e-4d72-b58e-1645f8d15925 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:42.299210 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d7566a5-553e-4d72-b58e-1645f8d15925 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:42.300237 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d7566a5-553e-4d72-b58e-1645f8d15925 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:42.300715 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d7566a5-553e-4d72-b58e-1645f8d15925 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:42.306083 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d7566a5-553e-4d72-b58e-1645f8d15925 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:42.473161 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f35e302c-2078-4a16-951c-b5e483a820b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:42.485120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f35e302c-2078-4a16-951c-b5e483a820b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.551850 Aug 31 11:43:42.485728 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 48/95] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:41 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:42.503468 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0190945d-ee90-4cdd-a331-4d2d5bbfd3c5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:42.504237 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-0190945d-ee90-4cdd-a331-4d2d5bbfd3c5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:42.512213 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0190945d-ee90-4cdd-a331-4d2d5bbfd3c5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:42.515909 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0190945d-ee90-4cdd-a331-4d2d5bbfd3c5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:42.516654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0190945d-ee90-4cdd-a331-4d2d5bbfd3c5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:42.524357 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0190945d-ee90-4cdd-a331-4d2d5bbfd3c5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:42.525489 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0190945d-ee90-4cdd-a331-4d2d5bbfd3c5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:42.528087 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0190945d-ee90-4cdd-a331-4d2d5bbfd3c5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:43.249107 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2d7566a5-553e-4d72-b58e-1645f8d15925 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:43.260140 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0190945d-ee90-4cdd-a331-4d2d5bbfd3c5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:43.278173 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0190945d-ee90-4cdd-a331-4d2d5bbfd3c5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.788855 Aug 31 11:43:43.278751 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 49/96] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:42 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:43.282006 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2d7566a5-553e-4d72-b58e-1645f8d15925 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.998056 Aug 31 11:43:43.282896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 48/97] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:42 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:43.289395 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-66c5b136-b7f4-462c-8c23-8d88deb958da tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:43.290620 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-66c5b136-b7f4-462c-8c23-8d88deb958da tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:43.295816 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-824e060f-ce7e-4069-a75c-6608fc37011b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:43.296755 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-824e060f-ce7e-4069-a75c-6608fc37011b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:43.310112 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-824e060f-ce7e-4069-a75c-6608fc37011b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:43.311108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-66c5b136-b7f4-462c-8c23-8d88deb958da tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:43.311752 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-66c5b136-b7f4-462c-8c23-8d88deb958da tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:43.312186 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-66c5b136-b7f4-462c-8c23-8d88deb958da tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:43.312959 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-66c5b136-b7f4-462c-8c23-8d88deb958da tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:43.313603 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-824e060f-ce7e-4069-a75c-6608fc37011b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:43.314032 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-824e060f-ce7e-4069-a75c-6608fc37011b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:43.314776 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-824e060f-ce7e-4069-a75c-6608fc37011b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:43.316377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-66c5b136-b7f4-462c-8c23-8d88deb958da tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:43.316838 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-66c5b136-b7f4-462c-8c23-8d88deb958da tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:43.317450 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-824e060f-ce7e-4069-a75c-6608fc37011b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:43.318065 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-824e060f-ce7e-4069-a75c-6608fc37011b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:43.837987 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-824e060f-ce7e-4069-a75c-6608fc37011b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:43.866164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-824e060f-ce7e-4069-a75c-6608fc37011b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.567353 Aug 31 11:43:43.867042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 50/98] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:43 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:43.897582 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-62e0014e-492e-4395-a0ae-e76f2e8f442b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:43.898357 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-62e0014e-492e-4395-a0ae-e76f2e8f442b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:43.903934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-66c5b136-b7f4-462c-8c23-8d88deb958da tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:43.905338 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62e0014e-492e-4395-a0ae-e76f2e8f442b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:43.906270 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62e0014e-492e-4395-a0ae-e76f2e8f442b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:43.906933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62e0014e-492e-4395-a0ae-e76f2e8f442b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:43.908377 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62e0014e-492e-4395-a0ae-e76f2e8f442b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:43.909659 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62e0014e-492e-4395-a0ae-e76f2e8f442b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:43.910391 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62e0014e-492e-4395-a0ae-e76f2e8f442b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:43.928463 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-66c5b136-b7f4-462c-8c23-8d88deb958da tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:43.934162 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-66c5b136-b7f4-462c-8c23-8d88deb958da tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:43.942016 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-66c5b136-b7f4-462c-8c23-8d88deb958da tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.649961 Aug 31 11:43:43.943238 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 49/99] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:43 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:44.300987 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c0de944e-58a6-491b-88fb-cc56826a595b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:44.301592 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c0de944e-58a6-491b-88fb-cc56826a595b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:44.310150 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c0de944e-58a6-491b-88fb-cc56826a595b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:44.310645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c0de944e-58a6-491b-88fb-cc56826a595b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:44.311089 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c0de944e-58a6-491b-88fb-cc56826a595b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:44.311770 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c0de944e-58a6-491b-88fb-cc56826a595b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:44.312214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c0de944e-58a6-491b-88fb-cc56826a595b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:44.312670 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c0de944e-58a6-491b-88fb-cc56826a595b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:44.398155 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:44.542779 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-62e0014e-492e-4395-a0ae-e76f2e8f442b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:44.554673 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-62e0014e-492e-4395-a0ae-e76f2e8f442b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.685652 Aug 31 11:43:44.571804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 51/100] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:43 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:44.587298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-24aeef51-827a-4158-8537-ed820be24ca6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:44.588202 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-24aeef51-827a-4158-8537-ed820be24ca6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:44.595335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-24aeef51-827a-4158-8537-ed820be24ca6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:44.596037 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-24aeef51-827a-4158-8537-ed820be24ca6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:44.597252 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-24aeef51-827a-4158-8537-ed820be24ca6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:44.598198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-24aeef51-827a-4158-8537-ed820be24ca6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:44.598791 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-24aeef51-827a-4158-8537-ed820be24ca6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:44.599350 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-24aeef51-827a-4158-8537-ed820be24ca6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:44.915786 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c0de944e-58a6-491b-88fb-cc56826a595b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:44.950449 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c0de944e-58a6-491b-88fb-cc56826a595b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.654356 Aug 31 11:43:44.952693 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 50/101] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:44 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:44.960068 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-57412ae5-fe84-47fb-8a67-7296df6618e6 req-ae00910b-c7de-4ecd-811d-ca1b43ac2863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cfd5ee-9585-4f45-b34a-b0e87ae35723", "tag": "06958dff-75ee-4641-9552-3e8769a2f96e"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:43:44.978098 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-57412ae5-fe84-47fb-8a67-7296df6618e6 req-ae00910b-c7de-4ecd-811d-ca1b43ac2863 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:44.978580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-57412ae5-fe84-47fb-8a67-7296df6618e6 req-ae00910b-c7de-4ecd-811d-ca1b43ac2863 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:44.979008 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-57412ae5-fe84-47fb-8a67-7296df6618e6 req-ae00910b-c7de-4ecd-811d-ca1b43ac2863 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:44.991338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-57412ae5-fe84-47fb-8a67-7296df6618e6 req-ae00910b-c7de-4ecd-811d-ca1b43ac2863 service nova] Creating event network-changed:06958dff-75ee-4641-9552-3e8769a2f96e for instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 on hv-cinder-83976 Aug 31 11:43:44.998354 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-57412ae5-fe84-47fb-8a67-7296df6618e6 req-ae00910b-c7de-4ecd-811d-ca1b43ac2863 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043048 Aug 31 11:43:44.999263 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 51/102] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:43:45.073104 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-24aeef51-827a-4158-8537-ed820be24ca6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:45.082273 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-24aeef51-827a-4158-8537-ed820be24ca6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.509102 Aug 31 11:43:45.084634 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 52/103] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:44 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:45.091494 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bac2b484-ba99-47ab-a5ef-376af5d8307f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:45.092137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-bac2b484-ba99-47ab-a5ef-376af5d8307f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:45.101291 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bac2b484-ba99-47ab-a5ef-376af5d8307f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:45.102013 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bac2b484-ba99-47ab-a5ef-376af5d8307f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:45.102679 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bac2b484-ba99-47ab-a5ef-376af5d8307f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:45.104050 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bac2b484-ba99-47ab-a5ef-376af5d8307f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:45.104347 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bac2b484-ba99-47ab-a5ef-376af5d8307f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:45.104820 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bac2b484-ba99-47ab-a5ef-376af5d8307f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:45.241379 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-64aa7fb5-2941-4b1c-9146-645abbff87ca req-353f2b7c-2232-430c-927c-57307c1fb025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee843c31-1261-43ec-8358-d9bdceb3fb26", "tag": "736b1786-49b6-4725-ae4c-14888fe4a5e3"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:43:45.251606 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-64aa7fb5-2941-4b1c-9146-645abbff87ca req-353f2b7c-2232-430c-927c-57307c1fb025 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:45.251606 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-64aa7fb5-2941-4b1c-9146-645abbff87ca req-353f2b7c-2232-430c-927c-57307c1fb025 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:45.251773 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-64aa7fb5-2941-4b1c-9146-645abbff87ca req-353f2b7c-2232-430c-927c-57307c1fb025 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:45.263630 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-64aa7fb5-2941-4b1c-9146-645abbff87ca req-353f2b7c-2232-430c-927c-57307c1fb025 service nova] Creating event network-changed:736b1786-49b6-4725-ae4c-14888fe4a5e3 for instance ee843c31-1261-43ec-8358-d9bdceb3fb26 on hv-cinder-83976 Aug 31 11:43:45.269177 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-64aa7fb5-2941-4b1c-9146-645abbff87ca req-353f2b7c-2232-430c-927c-57307c1fb025 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267456 Aug 31 11:43:45.269790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 52/104] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:43:45.276975 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4221ee8b-9bbc-491e-9711-097ec580c948 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:45.277687 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4221ee8b-9bbc-491e-9711-097ec580c948 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:45.284151 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4221ee8b-9bbc-491e-9711-097ec580c948 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:45.284676 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4221ee8b-9bbc-491e-9711-097ec580c948 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:45.285106 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4221ee8b-9bbc-491e-9711-097ec580c948 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:45.285802 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4221ee8b-9bbc-491e-9711-097ec580c948 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:45.286247 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4221ee8b-9bbc-491e-9711-097ec580c948 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:45.286692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4221ee8b-9bbc-491e-9711-097ec580c948 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:45.431507 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4221ee8b-9bbc-491e-9711-097ec580c948 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:45.441532 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4221ee8b-9bbc-491e-9711-097ec580c948 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:45.443304 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4221ee8b-9bbc-491e-9711-097ec580c948 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:45.444869 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4221ee8b-9bbc-491e-9711-097ec580c948 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.173012 Aug 31 11:43:45.445524 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 53/105] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:45 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:45.491488 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-bac2b484-ba99-47ab-a5ef-376af5d8307f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:45.499210 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-bac2b484-ba99-47ab-a5ef-376af5d8307f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.413359 Aug 31 11:43:45.499773 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 53/106] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:45 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:45.578055 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ff701e01-5125-4d2b-a72c-fb5378b7c7dd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:45.578836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ff701e01-5125-4d2b-a72c-fb5378b7c7dd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:45.587392 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ff701e01-5125-4d2b-a72c-fb5378b7c7dd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:45.587879 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ff701e01-5125-4d2b-a72c-fb5378b7c7dd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:45.588723 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ff701e01-5125-4d2b-a72c-fb5378b7c7dd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:45.589915 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ff701e01-5125-4d2b-a72c-fb5378b7c7dd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:45.590614 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ff701e01-5125-4d2b-a72c-fb5378b7c7dd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:45.591032 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ff701e01-5125-4d2b-a72c-fb5378b7c7dd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:45.738327 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ff701e01-5125-4d2b-a72c-fb5378b7c7dd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:45.746406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ff701e01-5125-4d2b-a72c-fb5378b7c7dd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.174818 Aug 31 11:43:45.746984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 54/107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:45 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:45.971275 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-294e7dd7-bda6-4f57-a5a1-1f30d4b3a63c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:45.971903 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-294e7dd7-bda6-4f57-a5a1-1f30d4b3a63c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:45.977954 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-294e7dd7-bda6-4f57-a5a1-1f30d4b3a63c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:45.978435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-294e7dd7-bda6-4f57-a5a1-1f30d4b3a63c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:45.978869 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-294e7dd7-bda6-4f57-a5a1-1f30d4b3a63c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:45.979552 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-294e7dd7-bda6-4f57-a5a1-1f30d4b3a63c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:45.980003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-294e7dd7-bda6-4f57-a5a1-1f30d4b3a63c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:45.980422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-294e7dd7-bda6-4f57-a5a1-1f30d4b3a63c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:46.104269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a2b398e1-4271-4066-a116-d4b129b0c09b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:46.105161 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a2b398e1-4271-4066-a116-d4b129b0c09b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:46.111038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a2b398e1-4271-4066-a116-d4b129b0c09b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:46.111492 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a2b398e1-4271-4066-a116-d4b129b0c09b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:46.112460 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a2b398e1-4271-4066-a116-d4b129b0c09b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:46.113167 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a2b398e1-4271-4066-a116-d4b129b0c09b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:46.113606 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a2b398e1-4271-4066-a116-d4b129b0c09b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:46.114051 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a2b398e1-4271-4066-a116-d4b129b0c09b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:46.157631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-294e7dd7-bda6-4f57-a5a1-1f30d4b3a63c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:46.172416 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-294e7dd7-bda6-4f57-a5a1-1f30d4b3a63c tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.204593 Aug 31 11:43:46.173473 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 54/108] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:45 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:46.461241 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a2b398e1-4271-4066-a116-d4b129b0c09b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:46.468483 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5035fcf7-a600-4796-b22a-3159f692bdd1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:46.469109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5035fcf7-a600-4796-b22a-3159f692bdd1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:46.480850 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a2b398e1-4271-4066-a116-d4b129b0c09b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.380396 Aug 31 11:43:46.481433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 55/109] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:46 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:46.483210 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5035fcf7-a600-4796-b22a-3159f692bdd1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:46.483913 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5035fcf7-a600-4796-b22a-3159f692bdd1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:46.484352 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5035fcf7-a600-4796-b22a-3159f692bdd1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:46.485078 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5035fcf7-a600-4796-b22a-3159f692bdd1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:46.485677 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5035fcf7-a600-4796-b22a-3159f692bdd1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:46.486246 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5035fcf7-a600-4796-b22a-3159f692bdd1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:46.520798 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-bf84b399-18fa-4f95-94de-5d627b139e3c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:46.521492 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-bf84b399-18fa-4f95-94de-5d627b139e3c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:46.528418 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bf84b399-18fa-4f95-94de-5d627b139e3c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:46.529335 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bf84b399-18fa-4f95-94de-5d627b139e3c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:46.529982 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bf84b399-18fa-4f95-94de-5d627b139e3c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:46.530682 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bf84b399-18fa-4f95-94de-5d627b139e3c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:46.531363 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bf84b399-18fa-4f95-94de-5d627b139e3c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:46.531861 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bf84b399-18fa-4f95-94de-5d627b139e3c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:46.638036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5035fcf7-a600-4796-b22a-3159f692bdd1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:46.648109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5035fcf7-a600-4796-b22a-3159f692bdd1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:46.650172 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5035fcf7-a600-4796-b22a-3159f692bdd1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:46.651300 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5035fcf7-a600-4796-b22a-3159f692bdd1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.186714 Aug 31 11:43:46.651850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 55/110] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:46 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:46.678727 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-bf84b399-18fa-4f95-94de-5d627b139e3c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:46.697302 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-bf84b399-18fa-4f95-94de-5d627b139e3c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.180582 Aug 31 11:43:46.705209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 56/111] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:46 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:46.767600 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-99d3057d-100a-48c3-b828-a32f2d2d77c4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:46.768904 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-99d3057d-100a-48c3-b828-a32f2d2d77c4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:46.776209 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-99d3057d-100a-48c3-b828-a32f2d2d77c4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:46.777009 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-99d3057d-100a-48c3-b828-a32f2d2d77c4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:46.777645 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-99d3057d-100a-48c3-b828-a32f2d2d77c4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:46.778706 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-99d3057d-100a-48c3-b828-a32f2d2d77c4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:46.779354 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-99d3057d-100a-48c3-b828-a32f2d2d77c4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:46.780004 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-99d3057d-100a-48c3-b828-a32f2d2d77c4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:46.944286 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-99d3057d-100a-48c3-b828-a32f2d2d77c4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:46.952073 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-99d3057d-100a-48c3-b828-a32f2d2d77c4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.188194 Aug 31 11:43:46.952675 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 56/112] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:46 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:47.030476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-bf59f046-6f18-49dc-bd14-eba38c8a5532 req-5bbe35f7-5034-4f22-9092-a834d93e7742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a562f1ce-b46b-464a-9a4c-a9963f56dceb", "tag": "2c28681a-1560-4376-a0ce-7c613cf6890b"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:43:47.039979 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-bf59f046-6f18-49dc-bd14-eba38c8a5532 req-5bbe35f7-5034-4f22-9092-a834d93e7742 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:47.040472 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-bf59f046-6f18-49dc-bd14-eba38c8a5532 req-5bbe35f7-5034-4f22-9092-a834d93e7742 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:47.040990 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-bf59f046-6f18-49dc-bd14-eba38c8a5532 req-5bbe35f7-5034-4f22-9092-a834d93e7742 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:47.052173 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-bf59f046-6f18-49dc-bd14-eba38c8a5532 req-5bbe35f7-5034-4f22-9092-a834d93e7742 service nova] Creating event network-changed:2c28681a-1560-4376-a0ce-7c613cf6890b for instance a562f1ce-b46b-464a-9a4c-a9963f56dceb on hv-cinder-83976 Aug 31 11:43:47.057237 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-bf59f046-6f18-49dc-bd14-eba38c8a5532 req-5bbe35f7-5034-4f22-9092-a834d93e7742 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030440 Aug 31 11:43:47.057858 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 57/113] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:43:47.196440 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ba3c627a-55b4-48ea-a7e8-bd9455cde633 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:47.196989 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ba3c627a-55b4-48ea-a7e8-bd9455cde633 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:47.203579 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ba3c627a-55b4-48ea-a7e8-bd9455cde633 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:47.204052 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ba3c627a-55b4-48ea-a7e8-bd9455cde633 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:47.204473 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ba3c627a-55b4-48ea-a7e8-bd9455cde633 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:47.205163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ba3c627a-55b4-48ea-a7e8-bd9455cde633 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:47.205635 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ba3c627a-55b4-48ea-a7e8-bd9455cde633 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:47.206137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ba3c627a-55b4-48ea-a7e8-bd9455cde633 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:47.285642 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-3e9b7d02-3a7c-42a0-91b2-65f6dcf4b527 req-50333818-369e-4639-a760-63a5d8067364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece59cd5-8579-4406-be68-9d0204aeb446", "tag": "df889158-674c-400a-bd63-cbcff640456f"}, {"name": "network-changed", "server_uuid": "5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab", "tag": "12ad6e71-b8c7-4384-9cc1-59620a27059b"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:43:47.296086 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-3e9b7d02-3a7c-42a0-91b2-65f6dcf4b527 req-50333818-369e-4639-a760-63a5d8067364 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:47.296605 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-3e9b7d02-3a7c-42a0-91b2-65f6dcf4b527 req-50333818-369e-4639-a760-63a5d8067364 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:47.297031 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-3e9b7d02-3a7c-42a0-91b2-65f6dcf4b527 req-50333818-369e-4639-a760-63a5d8067364 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:47.311041 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-3e9b7d02-3a7c-42a0-91b2-65f6dcf4b527 req-50333818-369e-4639-a760-63a5d8067364 service nova] Creating event network-changed:df889158-674c-400a-bd63-cbcff640456f for instance ece59cd5-8579-4406-be68-9d0204aeb446 on hv-cinder-83976 Aug 31 11:43:47.311541 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-3e9b7d02-3a7c-42a0-91b2-65f6dcf4b527 req-50333818-369e-4639-a760-63a5d8067364 service nova] Creating event network-changed:12ad6e71-b8c7-4384-9cc1-59620a27059b for instance 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab on hv-cinder-83976 Aug 31 11:43:47.319211 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-3e9b7d02-3a7c-42a0-91b2-65f6dcf4b527 req-50333818-369e-4639-a760-63a5d8067364 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038110 Aug 31 11:43:47.320206 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 58/114] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:43:47.340662 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ba3c627a-55b4-48ea-a7e8-bd9455cde633 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:47.349296 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ba3c627a-55b4-48ea-a7e8-bd9455cde633 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.157396 Aug 31 11:43:47.349854 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 57/115] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:47 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:47.501916 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-aa5fc52b-19c2-46ee-9d51-914f1bcc830f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:47.502581 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-aa5fc52b-19c2-46ee-9d51-914f1bcc830f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:47.509118 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-aa5fc52b-19c2-46ee-9d51-914f1bcc830f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:47.513330 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-aa5fc52b-19c2-46ee-9d51-914f1bcc830f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:47.513783 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-aa5fc52b-19c2-46ee-9d51-914f1bcc830f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:47.514483 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-aa5fc52b-19c2-46ee-9d51-914f1bcc830f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:47.515142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-aa5fc52b-19c2-46ee-9d51-914f1bcc830f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:47.515910 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-aa5fc52b-19c2-46ee-9d51-914f1bcc830f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:47.645315 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-aa5fc52b-19c2-46ee-9d51-914f1bcc830f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:47.653062 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-aa5fc52b-19c2-46ee-9d51-914f1bcc830f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.156002 Aug 31 11:43:47.653622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 59/116] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:47 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:47.672751 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7560b338-0adc-427e-b2e3-84a756dded9e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:47.673351 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7560b338-0adc-427e-b2e3-84a756dded9e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:47.679349 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7560b338-0adc-427e-b2e3-84a756dded9e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:47.679839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7560b338-0adc-427e-b2e3-84a756dded9e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:47.680267 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7560b338-0adc-427e-b2e3-84a756dded9e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:47.680971 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7560b338-0adc-427e-b2e3-84a756dded9e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:47.681666 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7560b338-0adc-427e-b2e3-84a756dded9e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:47.681833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7560b338-0adc-427e-b2e3-84a756dded9e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:47.718972 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1eff4f50-5d38-4bb3-b5ee-c8e733d485e5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:47.719576 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1eff4f50-5d38-4bb3-b5ee-c8e733d485e5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:47.726064 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1eff4f50-5d38-4bb3-b5ee-c8e733d485e5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:47.726524 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1eff4f50-5d38-4bb3-b5ee-c8e733d485e5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:47.726953 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1eff4f50-5d38-4bb3-b5ee-c8e733d485e5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:47.727635 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1eff4f50-5d38-4bb3-b5ee-c8e733d485e5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:47.728082 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1eff4f50-5d38-4bb3-b5ee-c8e733d485e5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:47.728512 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1eff4f50-5d38-4bb3-b5ee-c8e733d485e5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:47.811514 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7560b338-0adc-427e-b2e3-84a756dded9e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:47.820681 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7560b338-0adc-427e-b2e3-84a756dded9e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:47.822135 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7560b338-0adc-427e-b2e3-84a756dded9e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:47.823267 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7560b338-0adc-427e-b2e3-84a756dded9e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.154318 Aug 31 11:43:47.823860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 58/117] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:47 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:47.860112 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1eff4f50-5d38-4bb3-b5ee-c8e733d485e5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:47.868242 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1eff4f50-5d38-4bb3-b5ee-c8e733d485e5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.152963 Aug 31 11:43:47.868846 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 60/118] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:47 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:47.973768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5f19df84-6707-4308-8110-fffceb9987b0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:47.974634 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5f19df84-6707-4308-8110-fffceb9987b0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:47.980720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f19df84-6707-4308-8110-fffceb9987b0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:47.981206 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f19df84-6707-4308-8110-fffceb9987b0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:47.981638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f19df84-6707-4308-8110-fffceb9987b0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:47.982321 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f19df84-6707-4308-8110-fffceb9987b0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:47.982769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f19df84-6707-4308-8110-fffceb9987b0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:47.983190 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f19df84-6707-4308-8110-fffceb9987b0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:48.370345 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a1c72bb4-dab2-4920-bf2e-8a0d1d2ce864 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:48.371141 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a1c72bb4-dab2-4920-bf2e-8a0d1d2ce864 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:48.378841 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a1c72bb4-dab2-4920-bf2e-8a0d1d2ce864 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:48.379333 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a1c72bb4-dab2-4920-bf2e-8a0d1d2ce864 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:48.379765 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a1c72bb4-dab2-4920-bf2e-8a0d1d2ce864 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:48.380463 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a1c72bb4-dab2-4920-bf2e-8a0d1d2ce864 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:48.380929 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a1c72bb4-dab2-4920-bf2e-8a0d1d2ce864 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:48.381349 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a1c72bb4-dab2-4920-bf2e-8a0d1d2ce864 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:48.431132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5f19df84-6707-4308-8110-fffceb9987b0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:48.439489 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5f19df84-6707-4308-8110-fffceb9987b0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.470277 Aug 31 11:43:48.440897 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 59/119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:47 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:48.637998 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a1c72bb4-dab2-4920-bf2e-8a0d1d2ce864 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:48.645640 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a1c72bb4-dab2-4920-bf2e-8a0d1d2ce864 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.279575 Aug 31 11:43:48.646201 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 61/120] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:48 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:48.673824 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b7f378d1-68c5-43e7-a47f-828c5ac814ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:48.675090 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b7f378d1-68c5-43e7-a47f-828c5ac814ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:48.681320 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b7f378d1-68c5-43e7-a47f-828c5ac814ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:48.682309 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b7f378d1-68c5-43e7-a47f-828c5ac814ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:48.682309 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b7f378d1-68c5-43e7-a47f-828c5ac814ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:48.682893 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b7f378d1-68c5-43e7-a47f-828c5ac814ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:48.683340 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b7f378d1-68c5-43e7-a47f-828c5ac814ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:48.683761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b7f378d1-68c5-43e7-a47f-828c5ac814ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:48.811045 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b7f378d1-68c5-43e7-a47f-828c5ac814ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:48.818873 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b7f378d1-68c5-43e7-a47f-828c5ac814ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.148861 Aug 31 11:43:48.819433 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 60/121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:48 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:48.851910 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-56f8285d-68f1-4b4e-b900-48b560cd3ef5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:48.852447 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-56f8285d-68f1-4b4e-b900-48b560cd3ef5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:48.858351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-56f8285d-68f1-4b4e-b900-48b560cd3ef5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:48.858824 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-56f8285d-68f1-4b4e-b900-48b560cd3ef5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:48.859270 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-56f8285d-68f1-4b4e-b900-48b560cd3ef5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:48.859928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-56f8285d-68f1-4b4e-b900-48b560cd3ef5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:48.860371 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-56f8285d-68f1-4b4e-b900-48b560cd3ef5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:48.860818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-56f8285d-68f1-4b4e-b900-48b560cd3ef5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:48.889193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-31baf031-dac0-42e0-abad-64275b894017 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:48.889833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-31baf031-dac0-42e0-abad-64275b894017 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:48.895867 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31baf031-dac0-42e0-abad-64275b894017 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:48.896348 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31baf031-dac0-42e0-abad-64275b894017 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:48.896803 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31baf031-dac0-42e0-abad-64275b894017 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:48.897494 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31baf031-dac0-42e0-abad-64275b894017 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:48.897946 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31baf031-dac0-42e0-abad-64275b894017 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:48.898372 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31baf031-dac0-42e0-abad-64275b894017 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:48.999552 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-56f8285d-68f1-4b4e-b900-48b560cd3ef5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:49.007774 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-56f8285d-68f1-4b4e-b900-48b560cd3ef5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:49.009245 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-56f8285d-68f1-4b4e-b900-48b560cd3ef5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:49.010377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-56f8285d-68f1-4b4e-b900-48b560cd3ef5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.162368 Aug 31 11:43:49.010973 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 62/122] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:48 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:49.041465 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-31baf031-dac0-42e0-abad-64275b894017 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:49.049714 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-31baf031-dac0-42e0-abad-64275b894017 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.163753 Aug 31 11:43:49.050283 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 61/123] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:48 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:49.461376 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-45cb1498-9534-445d-9990-912eb0839a42 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:49.462236 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-45cb1498-9534-445d-9990-912eb0839a42 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:49.468498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45cb1498-9534-445d-9990-912eb0839a42 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:49.469002 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45cb1498-9534-445d-9990-912eb0839a42 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:49.469440 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45cb1498-9534-445d-9990-912eb0839a42 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:49.470210 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45cb1498-9534-445d-9990-912eb0839a42 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:49.470664 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45cb1498-9534-445d-9990-912eb0839a42 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:49.471812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45cb1498-9534-445d-9990-912eb0839a42 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:49.615443 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-45cb1498-9534-445d-9990-912eb0839a42 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:49.618942 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:49.623950 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-45cb1498-9534-445d-9990-912eb0839a42 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.166434 Aug 31 11:43:49.624878 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 63/124] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:49 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:49.666216 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6ace3071-c761-48f7-be4d-97401ee11049 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:49.666744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6ace3071-c761-48f7-be4d-97401ee11049 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:49.672678 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ace3071-c761-48f7-be4d-97401ee11049 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:49.673148 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ace3071-c761-48f7-be4d-97401ee11049 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:49.673592 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ace3071-c761-48f7-be4d-97401ee11049 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:49.674262 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ace3071-c761-48f7-be4d-97401ee11049 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:49.674705 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ace3071-c761-48f7-be4d-97401ee11049 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:49.675127 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ace3071-c761-48f7-be4d-97401ee11049 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:49.801031 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6ace3071-c761-48f7-be4d-97401ee11049 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:49.808474 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6ace3071-c761-48f7-be4d-97401ee11049 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.146216 Aug 31 11:43:49.809060 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 62/125] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:49 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:49.839090 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4f7eb086-b4e8-4677-b43f-01aff0465599 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:49.839698 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4f7eb086-b4e8-4677-b43f-01aff0465599 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:49.845745 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4f7eb086-b4e8-4677-b43f-01aff0465599 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:49.846306 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4f7eb086-b4e8-4677-b43f-01aff0465599 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:49.846751 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4f7eb086-b4e8-4677-b43f-01aff0465599 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:49.847400 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4f7eb086-b4e8-4677-b43f-01aff0465599 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:49.847847 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4f7eb086-b4e8-4677-b43f-01aff0465599 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:49.848265 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4f7eb086-b4e8-4677-b43f-01aff0465599 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:49.976803 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4f7eb086-b4e8-4677-b43f-01aff0465599 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:49.984318 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4f7eb086-b4e8-4677-b43f-01aff0465599 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.149090 Aug 31 11:43:49.984915 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 64/126] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:49 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:50.031947 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e20bfa17-0178-4f40-9531-0ddb48455b69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:50.032562 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e20bfa17-0178-4f40-9531-0ddb48455b69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:50.038597 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e20bfa17-0178-4f40-9531-0ddb48455b69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:50.039078 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e20bfa17-0178-4f40-9531-0ddb48455b69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:50.039506 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e20bfa17-0178-4f40-9531-0ddb48455b69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:50.040177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e20bfa17-0178-4f40-9531-0ddb48455b69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:50.040656 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e20bfa17-0178-4f40-9531-0ddb48455b69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:50.041073 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e20bfa17-0178-4f40-9531-0ddb48455b69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:50.071292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ddfdab0f-4c97-440e-80f6-c84657a66a2b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:50.071896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ddfdab0f-4c97-440e-80f6-c84657a66a2b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:50.083365 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ddfdab0f-4c97-440e-80f6-c84657a66a2b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:50.083844 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ddfdab0f-4c97-440e-80f6-c84657a66a2b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:50.084274 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ddfdab0f-4c97-440e-80f6-c84657a66a2b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:50.084998 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ddfdab0f-4c97-440e-80f6-c84657a66a2b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:50.085443 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ddfdab0f-4c97-440e-80f6-c84657a66a2b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:50.085861 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ddfdab0f-4c97-440e-80f6-c84657a66a2b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:50.173547 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e20bfa17-0178-4f40-9531-0ddb48455b69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:50.182726 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e20bfa17-0178-4f40-9531-0ddb48455b69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:50.184413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e20bfa17-0178-4f40-9531-0ddb48455b69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:50.185539 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e20bfa17-0178-4f40-9531-0ddb48455b69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.157381 Aug 31 11:43:50.186093 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 63/127] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:50 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:50.220188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ddfdab0f-4c97-440e-80f6-c84657a66a2b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:50.229030 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ddfdab0f-4c97-440e-80f6-c84657a66a2b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.161490 Aug 31 11:43:50.229591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 65/128] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:50 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:50.646134 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9a906b9b-36f2-42b5-a793-ef77fd558b0c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:50.646742 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9a906b9b-36f2-42b5-a793-ef77fd558b0c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:50.652717 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9a906b9b-36f2-42b5-a793-ef77fd558b0c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:50.653198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9a906b9b-36f2-42b5-a793-ef77fd558b0c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:50.653630 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9a906b9b-36f2-42b5-a793-ef77fd558b0c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:50.654311 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9a906b9b-36f2-42b5-a793-ef77fd558b0c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:50.654767 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9a906b9b-36f2-42b5-a793-ef77fd558b0c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:50.655192 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9a906b9b-36f2-42b5-a793-ef77fd558b0c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:50.785269 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9a906b9b-36f2-42b5-a793-ef77fd558b0c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:50.788634 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:50.794029 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9a906b9b-36f2-42b5-a793-ef77fd558b0c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.152629 Aug 31 11:43:50.794585 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 64/129] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:50 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:50.829967 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-388d7c54-6667-4b2d-ab58-691fa66ca689 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:50.831251 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-388d7c54-6667-4b2d-ab58-691fa66ca689 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:50.837317 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-388d7c54-6667-4b2d-ab58-691fa66ca689 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:50.837864 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-388d7c54-6667-4b2d-ab58-691fa66ca689 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:50.838299 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-388d7c54-6667-4b2d-ab58-691fa66ca689 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:50.838972 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-388d7c54-6667-4b2d-ab58-691fa66ca689 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:50.839443 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-388d7c54-6667-4b2d-ab58-691fa66ca689 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:50.839966 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-388d7c54-6667-4b2d-ab58-691fa66ca689 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:50.968439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-388d7c54-6667-4b2d-ab58-691fa66ca689 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:50.976818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-388d7c54-6667-4b2d-ab58-691fa66ca689 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.150692 Aug 31 11:43:50.977381 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 66/130] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:50 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:51.006114 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d7e1c773-ed50-4ec6-8b2a-a66c8cda6197 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:51.006732 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d7e1c773-ed50-4ec6-8b2a-a66c8cda6197 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:51.012611 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d7e1c773-ed50-4ec6-8b2a-a66c8cda6197 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:51.013087 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d7e1c773-ed50-4ec6-8b2a-a66c8cda6197 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:51.013510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d7e1c773-ed50-4ec6-8b2a-a66c8cda6197 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:51.014184 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d7e1c773-ed50-4ec6-8b2a-a66c8cda6197 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:51.014629 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d7e1c773-ed50-4ec6-8b2a-a66c8cda6197 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:51.015043 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d7e1c773-ed50-4ec6-8b2a-a66c8cda6197 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:51.145548 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d7e1c773-ed50-4ec6-8b2a-a66c8cda6197 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:51.153103 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d7e1c773-ed50-4ec6-8b2a-a66c8cda6197 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.151659 Aug 31 11:43:51.153654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 65/131] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:51 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:51.209189 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c795fcc8-1eb0-465a-8eb6-32d4efa5aade tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:51.209794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c795fcc8-1eb0-465a-8eb6-32d4efa5aade tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:51.215648 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c795fcc8-1eb0-465a-8eb6-32d4efa5aade tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:51.216125 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c795fcc8-1eb0-465a-8eb6-32d4efa5aade tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:51.216583 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c795fcc8-1eb0-465a-8eb6-32d4efa5aade tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:51.217262 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c795fcc8-1eb0-465a-8eb6-32d4efa5aade tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:51.217789 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c795fcc8-1eb0-465a-8eb6-32d4efa5aade tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:51.218114 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c795fcc8-1eb0-465a-8eb6-32d4efa5aade tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:51.253241 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f37cf3b0-7d97-4d4f-8207-4eb63f21ec80 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:51.253832 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f37cf3b0-7d97-4d4f-8207-4eb63f21ec80 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:51.259646 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f37cf3b0-7d97-4d4f-8207-4eb63f21ec80 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:51.260146 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f37cf3b0-7d97-4d4f-8207-4eb63f21ec80 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:51.260598 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f37cf3b0-7d97-4d4f-8207-4eb63f21ec80 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:51.261329 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f37cf3b0-7d97-4d4f-8207-4eb63f21ec80 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:51.261772 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f37cf3b0-7d97-4d4f-8207-4eb63f21ec80 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:51.262193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f37cf3b0-7d97-4d4f-8207-4eb63f21ec80 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:51.357928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c795fcc8-1eb0-465a-8eb6-32d4efa5aade tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:51.366937 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c795fcc8-1eb0-465a-8eb6-32d4efa5aade tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:51.368387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c795fcc8-1eb0-465a-8eb6-32d4efa5aade tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:51.369525 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c795fcc8-1eb0-465a-8eb6-32d4efa5aade tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.164892 Aug 31 11:43:51.370275 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 67/132] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:51 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:51.395829 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f37cf3b0-7d97-4d4f-8207-4eb63f21ec80 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:51.403301 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f37cf3b0-7d97-4d4f-8207-4eb63f21ec80 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.154580 Aug 31 11:43:51.403848 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 66/133] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:51 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:51.813285 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ace247f1-94b1-42ff-85d9-97e8691fd486 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:51.813894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ace247f1-94b1-42ff-85d9-97e8691fd486 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:51.820146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ace247f1-94b1-42ff-85d9-97e8691fd486 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:51.820667 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ace247f1-94b1-42ff-85d9-97e8691fd486 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:51.821151 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ace247f1-94b1-42ff-85d9-97e8691fd486 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:51.821830 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ace247f1-94b1-42ff-85d9-97e8691fd486 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:51.822275 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ace247f1-94b1-42ff-85d9-97e8691fd486 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:51.822692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ace247f1-94b1-42ff-85d9-97e8691fd486 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:51.947204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ace247f1-94b1-42ff-85d9-97e8691fd486 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:51.954723 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ace247f1-94b1-42ff-85d9-97e8691fd486 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.145246 Aug 31 11:43:51.955283 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 68/134] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:51 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:51.997367 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c83d9aff-6327-4f64-82b0-2593e20322fd tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:51.997964 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c83d9aff-6327-4f64-82b0-2593e20322fd tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:52.003896 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c83d9aff-6327-4f64-82b0-2593e20322fd tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:52.004372 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c83d9aff-6327-4f64-82b0-2593e20322fd tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:52.004836 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c83d9aff-6327-4f64-82b0-2593e20322fd tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:52.005508 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c83d9aff-6327-4f64-82b0-2593e20322fd tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:52.005954 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c83d9aff-6327-4f64-82b0-2593e20322fd tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:52.006373 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c83d9aff-6327-4f64-82b0-2593e20322fd tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:52.133109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c83d9aff-6327-4f64-82b0-2593e20322fd tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:52.140834 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c83d9aff-6327-4f64-82b0-2593e20322fd tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.147215 Aug 31 11:43:52.141493 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 67/135] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:51 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:52.172484 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5e895133-ed0d-45d6-8a67-fbfeea6ca084 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:52.173195 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5e895133-ed0d-45d6-8a67-fbfeea6ca084 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:52.179192 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e895133-ed0d-45d6-8a67-fbfeea6ca084 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:52.179666 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e895133-ed0d-45d6-8a67-fbfeea6ca084 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:52.180096 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e895133-ed0d-45d6-8a67-fbfeea6ca084 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:52.180799 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e895133-ed0d-45d6-8a67-fbfeea6ca084 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:52.181248 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e895133-ed0d-45d6-8a67-fbfeea6ca084 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:52.181666 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e895133-ed0d-45d6-8a67-fbfeea6ca084 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:52.315319 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5e895133-ed0d-45d6-8a67-fbfeea6ca084 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:52.323087 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5e895133-ed0d-45d6-8a67-fbfeea6ca084 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.154377 Aug 31 11:43:52.323660 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 69/136] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:52 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:52.392449 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8dea680f-69f2-408b-900d-ef39c93cc229 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:52.393768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8dea680f-69f2-408b-900d-ef39c93cc229 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:52.399865 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8dea680f-69f2-408b-900d-ef39c93cc229 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:52.400349 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8dea680f-69f2-408b-900d-ef39c93cc229 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:52.400807 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8dea680f-69f2-408b-900d-ef39c93cc229 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:52.401486 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8dea680f-69f2-408b-900d-ef39c93cc229 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:52.401934 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8dea680f-69f2-408b-900d-ef39c93cc229 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:52.402357 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8dea680f-69f2-408b-900d-ef39c93cc229 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:52.423134 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c847e1fa-351c-4d37-b123-7b36d22172d8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:52.423874 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c847e1fa-351c-4d37-b123-7b36d22172d8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:52.430201 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c847e1fa-351c-4d37-b123-7b36d22172d8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:52.430683 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c847e1fa-351c-4d37-b123-7b36d22172d8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:52.431120 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c847e1fa-351c-4d37-b123-7b36d22172d8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:52.431805 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c847e1fa-351c-4d37-b123-7b36d22172d8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:52.432253 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c847e1fa-351c-4d37-b123-7b36d22172d8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:52.432724 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c847e1fa-351c-4d37-b123-7b36d22172d8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:52.535412 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8dea680f-69f2-408b-900d-ef39c93cc229 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:52.544026 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8dea680f-69f2-408b-900d-ef39c93cc229 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:52.545491 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8dea680f-69f2-408b-900d-ef39c93cc229 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:52.546581 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8dea680f-69f2-408b-900d-ef39c93cc229 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.158136 Aug 31 11:43:52.547134 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 68/137] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:52 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:52.563035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c847e1fa-351c-4d37-b123-7b36d22172d8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:52.571438 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c847e1fa-351c-4d37-b123-7b36d22172d8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.152261 Aug 31 11:43:52.572036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 70/138] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:52 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:52.974995 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-88c9fbc5-55e1-432a-9039-fd15cd0b0216 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:52.975596 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-88c9fbc5-55e1-432a-9039-fd15cd0b0216 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:52.981602 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88c9fbc5-55e1-432a-9039-fd15cd0b0216 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:52.982074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88c9fbc5-55e1-432a-9039-fd15cd0b0216 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:52.982499 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88c9fbc5-55e1-432a-9039-fd15cd0b0216 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:52.983178 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88c9fbc5-55e1-432a-9039-fd15cd0b0216 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:52.983612 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88c9fbc5-55e1-432a-9039-fd15cd0b0216 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:52.984027 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88c9fbc5-55e1-432a-9039-fd15cd0b0216 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:53.116792 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-88c9fbc5-55e1-432a-9039-fd15cd0b0216 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:53.124267 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-88c9fbc5-55e1-432a-9039-fd15cd0b0216 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.153106 Aug 31 11:43:53.124867 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 69/139] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:52 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:53.163113 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b5a90c7b-51e4-4e09-9a98-39b6eed9bb26 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:53.163907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b5a90c7b-51e4-4e09-9a98-39b6eed9bb26 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:53.166760 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:53.170461 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5a90c7b-51e4-4e09-9a98-39b6eed9bb26 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:53.170965 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5a90c7b-51e4-4e09-9a98-39b6eed9bb26 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:53.171376 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5a90c7b-51e4-4e09-9a98-39b6eed9bb26 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:53.172068 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5a90c7b-51e4-4e09-9a98-39b6eed9bb26 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:53.172540 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5a90c7b-51e4-4e09-9a98-39b6eed9bb26 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:53.173098 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5a90c7b-51e4-4e09-9a98-39b6eed9bb26 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:53.313590 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b5a90c7b-51e4-4e09-9a98-39b6eed9bb26 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:53.322046 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b5a90c7b-51e4-4e09-9a98-39b6eed9bb26 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.163548 Aug 31 11:43:53.322609 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 71/140] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:53 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:53.344269 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e99a9816-61fd-4e35-9f4c-b20f5f90604e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:53.344931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e99a9816-61fd-4e35-9f4c-b20f5f90604e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:53.351282 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e99a9816-61fd-4e35-9f4c-b20f5f90604e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:53.351753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e99a9816-61fd-4e35-9f4c-b20f5f90604e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:53.352178 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e99a9816-61fd-4e35-9f4c-b20f5f90604e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:53.352887 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e99a9816-61fd-4e35-9f4c-b20f5f90604e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:53.353332 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e99a9816-61fd-4e35-9f4c-b20f5f90604e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:53.353753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e99a9816-61fd-4e35-9f4c-b20f5f90604e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:53.483616 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e99a9816-61fd-4e35-9f4c-b20f5f90604e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:53.493050 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e99a9816-61fd-4e35-9f4c-b20f5f90604e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.152634 Aug 31 11:43:53.493615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 70/141] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:53 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:53.569814 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e27d74f9-09bb-4cbf-b3c5-d5b1b1b1c3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:53.570422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e27d74f9-09bb-4cbf-b3c5-d5b1b1b1c3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:53.576333 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e27d74f9-09bb-4cbf-b3c5-d5b1b1b1c3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:53.576852 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e27d74f9-09bb-4cbf-b3c5-d5b1b1b1c3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:53.577289 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e27d74f9-09bb-4cbf-b3c5-d5b1b1b1c3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:53.577969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e27d74f9-09bb-4cbf-b3c5-d5b1b1b1c3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:53.578420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e27d74f9-09bb-4cbf-b3c5-d5b1b1b1c3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:53.578843 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e27d74f9-09bb-4cbf-b3c5-d5b1b1b1c3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:53.591980 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6760caf6-7cc8-49b6-b34c-a8d06afdb60c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:53.592640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6760caf6-7cc8-49b6-b34c-a8d06afdb60c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:53.599158 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6760caf6-7cc8-49b6-b34c-a8d06afdb60c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:53.599632 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6760caf6-7cc8-49b6-b34c-a8d06afdb60c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:53.600055 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6760caf6-7cc8-49b6-b34c-a8d06afdb60c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:53.600756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6760caf6-7cc8-49b6-b34c-a8d06afdb60c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:53.601295 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6760caf6-7cc8-49b6-b34c-a8d06afdb60c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:53.601874 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6760caf6-7cc8-49b6-b34c-a8d06afdb60c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:53.712126 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e27d74f9-09bb-4cbf-b3c5-d5b1b1b1c3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:53.720071 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e27d74f9-09bb-4cbf-b3c5-d5b1b1b1c3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:53.722573 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e27d74f9-09bb-4cbf-b3c5-d5b1b1b1c3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:53.723857 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e27d74f9-09bb-4cbf-b3c5-d5b1b1b1c3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.158809 Aug 31 11:43:53.724442 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 72/142] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:53 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:53.740308 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6760caf6-7cc8-49b6-b34c-a8d06afdb60c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:53.747921 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6760caf6-7cc8-49b6-b34c-a8d06afdb60c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.159716 Aug 31 11:43:53.748472 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 71/143] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:53 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:54.146276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-fe22a99b-e09b-40a8-82fb-0c52e7341731 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:54.146880 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-fe22a99b-e09b-40a8-82fb-0c52e7341731 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:54.153051 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe22a99b-e09b-40a8-82fb-0c52e7341731 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:54.153569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe22a99b-e09b-40a8-82fb-0c52e7341731 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:54.154004 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe22a99b-e09b-40a8-82fb-0c52e7341731 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:54.154686 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe22a99b-e09b-40a8-82fb-0c52e7341731 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:54.155139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe22a99b-e09b-40a8-82fb-0c52e7341731 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:54.155560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe22a99b-e09b-40a8-82fb-0c52e7341731 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:54.289356 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-fe22a99b-e09b-40a8-82fb-0c52e7341731 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:54.297121 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-fe22a99b-e09b-40a8-82fb-0c52e7341731 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.155416 Aug 31 11:43:54.297686 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 73/144] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:54 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:54.342340 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5f7e57a8-4f26-4943-a0cd-b8cc3796e06a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:54.342989 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5f7e57a8-4f26-4943-a0cd-b8cc3796e06a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:54.348951 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f7e57a8-4f26-4943-a0cd-b8cc3796e06a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:54.349426 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f7e57a8-4f26-4943-a0cd-b8cc3796e06a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:54.349866 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f7e57a8-4f26-4943-a0cd-b8cc3796e06a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:54.350537 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f7e57a8-4f26-4943-a0cd-b8cc3796e06a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:54.350976 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f7e57a8-4f26-4943-a0cd-b8cc3796e06a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:54.351389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f7e57a8-4f26-4943-a0cd-b8cc3796e06a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:54.492222 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5f7e57a8-4f26-4943-a0cd-b8cc3796e06a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:54.499875 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5f7e57a8-4f26-4943-a0cd-b8cc3796e06a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.161277 Aug 31 11:43:54.500429 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 72/145] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:54 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:54.513822 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7d222971-cd70-41a9-9b96-5e90949f4514 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:54.515020 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-7d222971-cd70-41a9-9b96-5e90949f4514 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:54.525632 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d222971-cd70-41a9-9b96-5e90949f4514 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:54.526221 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d222971-cd70-41a9-9b96-5e90949f4514 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:54.526735 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d222971-cd70-41a9-9b96-5e90949f4514 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:54.527479 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d222971-cd70-41a9-9b96-5e90949f4514 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:54.528039 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d222971-cd70-41a9-9b96-5e90949f4514 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:54.528583 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d222971-cd70-41a9-9b96-5e90949f4514 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:54.653956 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7d222971-cd70-41a9-9b96-5e90949f4514 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:54.662036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-7d222971-cd70-41a9-9b96-5e90949f4514 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.152297 Aug 31 11:43:54.662599 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 74/146] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:54 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:54.746173 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-42c59360-44c8-49ed-a55d-58772e8b1e69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:54.746768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-42c59360-44c8-49ed-a55d-58772e8b1e69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:54.753159 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-42c59360-44c8-49ed-a55d-58772e8b1e69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:54.753719 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-42c59360-44c8-49ed-a55d-58772e8b1e69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:54.754143 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-42c59360-44c8-49ed-a55d-58772e8b1e69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:54.754809 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-42c59360-44c8-49ed-a55d-58772e8b1e69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:54.755246 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-42c59360-44c8-49ed-a55d-58772e8b1e69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:54.755656 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-42c59360-44c8-49ed-a55d-58772e8b1e69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:54.768532 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c8343fd0-b77e-4b76-898f-dc3ab1c3de37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:54.769146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c8343fd0-b77e-4b76-898f-dc3ab1c3de37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:54.775064 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c8343fd0-b77e-4b76-898f-dc3ab1c3de37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:54.775548 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c8343fd0-b77e-4b76-898f-dc3ab1c3de37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:54.775978 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c8343fd0-b77e-4b76-898f-dc3ab1c3de37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:54.776693 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c8343fd0-b77e-4b76-898f-dc3ab1c3de37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:54.777147 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c8343fd0-b77e-4b76-898f-dc3ab1c3de37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:54.777567 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c8343fd0-b77e-4b76-898f-dc3ab1c3de37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:54.889047 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-42c59360-44c8-49ed-a55d-58772e8b1e69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:54.897362 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-42c59360-44c8-49ed-a55d-58772e8b1e69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:54.898839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-42c59360-44c8-49ed-a55d-58772e8b1e69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:54.899937 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-42c59360-44c8-49ed-a55d-58772e8b1e69 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.158026 Aug 31 11:43:54.900512 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 73/147] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:54 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:54.904941 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c8343fd0-b77e-4b76-898f-dc3ab1c3de37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:54.913918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c8343fd0-b77e-4b76-898f-dc3ab1c3de37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.149740 Aug 31 11:43:54.914480 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 75/148] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:54 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:55.320031 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a90815b1-95fb-4006-8d01-cfd173c320d7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:55.320722 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a90815b1-95fb-4006-8d01-cfd173c320d7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:55.323863 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:55.328024 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a90815b1-95fb-4006-8d01-cfd173c320d7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:55.328582 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a90815b1-95fb-4006-8d01-cfd173c320d7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:55.329005 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a90815b1-95fb-4006-8d01-cfd173c320d7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:55.329675 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a90815b1-95fb-4006-8d01-cfd173c320d7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:55.330116 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a90815b1-95fb-4006-8d01-cfd173c320d7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:55.330530 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a90815b1-95fb-4006-8d01-cfd173c320d7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:55.462173 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a90815b1-95fb-4006-8d01-cfd173c320d7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:55.469783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a90815b1-95fb-4006-8d01-cfd173c320d7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.153598 Aug 31 11:43:55.470338 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 74/149] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:55 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:55.522478 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e64dbf1a-b2e1-44fb-ab43-67489649b5de tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:55.523147 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e64dbf1a-b2e1-44fb-ab43-67489649b5de tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:55.529678 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e64dbf1a-b2e1-44fb-ab43-67489649b5de tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:55.530157 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e64dbf1a-b2e1-44fb-ab43-67489649b5de tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:55.530597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e64dbf1a-b2e1-44fb-ab43-67489649b5de tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:55.531276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e64dbf1a-b2e1-44fb-ab43-67489649b5de tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:55.531725 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e64dbf1a-b2e1-44fb-ab43-67489649b5de tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:55.532144 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e64dbf1a-b2e1-44fb-ab43-67489649b5de tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:55.667768 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e64dbf1a-b2e1-44fb-ab43-67489649b5de tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:55.675472 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e64dbf1a-b2e1-44fb-ab43-67489649b5de tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.157844 Aug 31 11:43:55.676129 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 76/150] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:55 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:55.685924 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-471c3181-9d92-48d7-ba06-092c6ab11e13 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:55.685924 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-471c3181-9d92-48d7-ba06-092c6ab11e13 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:55.689010 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-471c3181-9d92-48d7-ba06-092c6ab11e13 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:55.689486 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-471c3181-9d92-48d7-ba06-092c6ab11e13 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:55.689907 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-471c3181-9d92-48d7-ba06-092c6ab11e13 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:55.691223 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-471c3181-9d92-48d7-ba06-092c6ab11e13 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:55.691661 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-471c3181-9d92-48d7-ba06-092c6ab11e13 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:55.692072 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-471c3181-9d92-48d7-ba06-092c6ab11e13 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:55.819302 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-471c3181-9d92-48d7-ba06-092c6ab11e13 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:55.827140 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-471c3181-9d92-48d7-ba06-092c6ab11e13 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.148846 Aug 31 11:43:55.827639 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 75/151] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:55 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:55.922864 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a95fe72c-380b-4334-971e-4e0fb46f46e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:55.923484 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a95fe72c-380b-4334-971e-4e0fb46f46e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:55.929950 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a95fe72c-380b-4334-971e-4e0fb46f46e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:55.930426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a95fe72c-380b-4334-971e-4e0fb46f46e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:55.930845 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a95fe72c-380b-4334-971e-4e0fb46f46e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:55.931514 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a95fe72c-380b-4334-971e-4e0fb46f46e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:55.931954 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a95fe72c-380b-4334-971e-4e0fb46f46e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:55.932372 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a95fe72c-380b-4334-971e-4e0fb46f46e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:55.933713 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-af0c273f-c735-4f59-9c58-7ec9a867ed89 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:55.934314 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-af0c273f-c735-4f59-9c58-7ec9a867ed89 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:55.940106 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af0c273f-c735-4f59-9c58-7ec9a867ed89 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:55.941435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af0c273f-c735-4f59-9c58-7ec9a867ed89 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:55.941869 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af0c273f-c735-4f59-9c58-7ec9a867ed89 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:55.942542 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af0c273f-c735-4f59-9c58-7ec9a867ed89 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:55.942987 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af0c273f-c735-4f59-9c58-7ec9a867ed89 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:55.943402 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af0c273f-c735-4f59-9c58-7ec9a867ed89 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:56.065005 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a95fe72c-380b-4334-971e-4e0fb46f46e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:56.074266 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a95fe72c-380b-4334-971e-4e0fb46f46e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:56.075883 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a95fe72c-380b-4334-971e-4e0fb46f46e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:56.077046 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a95fe72c-380b-4334-971e-4e0fb46f46e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.157996 Aug 31 11:43:56.077665 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 77/152] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:55 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:56.078068 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-af0c273f-c735-4f59-9c58-7ec9a867ed89 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:56.086079 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-af0c273f-c735-4f59-9c58-7ec9a867ed89 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.156083 Aug 31 11:43:56.086634 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 76/153] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:55 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:56.491271 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7e50b13b-7593-419e-ac8b-bfded217a8e3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:56.491869 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-7e50b13b-7593-419e-ac8b-bfded217a8e3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:56.497804 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e50b13b-7593-419e-ac8b-bfded217a8e3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:56.498274 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e50b13b-7593-419e-ac8b-bfded217a8e3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:56.498696 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e50b13b-7593-419e-ac8b-bfded217a8e3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:56.499363 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e50b13b-7593-419e-ac8b-bfded217a8e3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:56.499802 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e50b13b-7593-419e-ac8b-bfded217a8e3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:56.500215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e50b13b-7593-419e-ac8b-bfded217a8e3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:56.630505 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7e50b13b-7593-419e-ac8b-bfded217a8e3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:56.638264 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-7e50b13b-7593-419e-ac8b-bfded217a8e3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.152080 Aug 31 11:43:56.638833 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 78/154] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:56 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:56.697273 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-eba449ec-750e-4606-a85f-fd12a955631a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:56.697870 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-eba449ec-750e-4606-a85f-fd12a955631a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:56.703701 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eba449ec-750e-4606-a85f-fd12a955631a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:56.704172 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eba449ec-750e-4606-a85f-fd12a955631a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:56.704634 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eba449ec-750e-4606-a85f-fd12a955631a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:56.705303 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eba449ec-750e-4606-a85f-fd12a955631a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:56.705738 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eba449ec-750e-4606-a85f-fd12a955631a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:56.706672 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eba449ec-750e-4606-a85f-fd12a955631a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:56.836717 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-eba449ec-750e-4606-a85f-fd12a955631a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:56.844236 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-eba449ec-750e-4606-a85f-fd12a955631a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.150869 Aug 31 11:43:56.844814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 77/155] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:56 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:56.847713 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-dd6c0034-efa4-41ae-b7ff-aecacd3794cc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:56.848337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-dd6c0034-efa4-41ae-b7ff-aecacd3794cc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:56.854177 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd6c0034-efa4-41ae-b7ff-aecacd3794cc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:56.854654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd6c0034-efa4-41ae-b7ff-aecacd3794cc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:56.855084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd6c0034-efa4-41ae-b7ff-aecacd3794cc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:56.855758 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd6c0034-efa4-41ae-b7ff-aecacd3794cc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:56.856206 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd6c0034-efa4-41ae-b7ff-aecacd3794cc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:56.856655 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd6c0034-efa4-41ae-b7ff-aecacd3794cc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:56.985022 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-dd6c0034-efa4-41ae-b7ff-aecacd3794cc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:56.992603 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-dd6c0034-efa4-41ae-b7ff-aecacd3794cc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.149416 Aug 31 11:43:56.993165 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 79/156] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:56 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:57.099257 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f8aa14d2-bb42-4304-a67a-9c7593e1b38e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:57.099890 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f8aa14d2-bb42-4304-a67a-9c7593e1b38e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:57.105123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9edd8029-025b-486a-85c3-e32360c63942 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:57.105749 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9edd8029-025b-486a-85c3-e32360c63942 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:57.105973 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f8aa14d2-bb42-4304-a67a-9c7593e1b38e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:57.106455 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f8aa14d2-bb42-4304-a67a-9c7593e1b38e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:57.106885 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f8aa14d2-bb42-4304-a67a-9c7593e1b38e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:57.107572 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f8aa14d2-bb42-4304-a67a-9c7593e1b38e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:57.108015 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f8aa14d2-bb42-4304-a67a-9c7593e1b38e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:57.108437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f8aa14d2-bb42-4304-a67a-9c7593e1b38e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:57.111615 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9edd8029-025b-486a-85c3-e32360c63942 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:57.112085 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9edd8029-025b-486a-85c3-e32360c63942 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:57.112528 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9edd8029-025b-486a-85c3-e32360c63942 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:57.113206 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9edd8029-025b-486a-85c3-e32360c63942 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:57.113648 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9edd8029-025b-486a-85c3-e32360c63942 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:57.114063 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9edd8029-025b-486a-85c3-e32360c63942 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:57.131783 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:57.240625 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f8aa14d2-bb42-4304-a67a-9c7593e1b38e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:57.241649 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9edd8029-025b-486a-85c3-e32360c63942 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:57.249491 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f8aa14d2-bb42-4304-a67a-9c7593e1b38e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:57.251089 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f8aa14d2-bb42-4304-a67a-9c7593e1b38e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:57.251270 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9edd8029-025b-486a-85c3-e32360c63942 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.149824 Aug 31 11:43:57.251995 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 80/157] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:57 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:57.252251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f8aa14d2-bb42-4304-a67a-9c7593e1b38e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.157214 Aug 31 11:43:57.253358 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 78/158] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:57 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:43:57.659039 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a89cd1da-4e23-44df-b66f-2102b74535bd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:57.659644 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a89cd1da-4e23-44df-b66f-2102b74535bd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:57.665603 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a89cd1da-4e23-44df-b66f-2102b74535bd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:57.666082 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a89cd1da-4e23-44df-b66f-2102b74535bd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:57.666511 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a89cd1da-4e23-44df-b66f-2102b74535bd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:57.667197 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a89cd1da-4e23-44df-b66f-2102b74535bd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:57.667639 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a89cd1da-4e23-44df-b66f-2102b74535bd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:57.668061 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a89cd1da-4e23-44df-b66f-2102b74535bd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:57.809336 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a89cd1da-4e23-44df-b66f-2102b74535bd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:57.817875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a89cd1da-4e23-44df-b66f-2102b74535bd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.162627 Aug 31 11:43:57.818440 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 81/159] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:57 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:57.864538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-378af176-2bda-4409-a64f-32b4c5ba1ea6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:57.865698 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-378af176-2bda-4409-a64f-32b4c5ba1ea6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:57.871800 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-378af176-2bda-4409-a64f-32b4c5ba1ea6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:57.872283 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-378af176-2bda-4409-a64f-32b4c5ba1ea6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:57.872739 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-378af176-2bda-4409-a64f-32b4c5ba1ea6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:57.873423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-378af176-2bda-4409-a64f-32b4c5ba1ea6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:57.873871 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-378af176-2bda-4409-a64f-32b4c5ba1ea6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:57.874404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-378af176-2bda-4409-a64f-32b4c5ba1ea6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:58.000850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-378af176-2bda-4409-a64f-32b4c5ba1ea6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:58.008745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-378af176-2bda-4409-a64f-32b4c5ba1ea6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.148013 Aug 31 11:43:58.009305 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 79/160] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:57 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:58.013114 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c1fa8142-bbef-416a-80b3-a93604e4ec06 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:58.013839 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c1fa8142-bbef-416a-80b3-a93604e4ec06 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:58.019793 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1fa8142-bbef-416a-80b3-a93604e4ec06 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:58.020261 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1fa8142-bbef-416a-80b3-a93604e4ec06 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:58.020730 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1fa8142-bbef-416a-80b3-a93604e4ec06 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:58.021381 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1fa8142-bbef-416a-80b3-a93604e4ec06 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:58.021815 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1fa8142-bbef-416a-80b3-a93604e4ec06 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:58.022225 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1fa8142-bbef-416a-80b3-a93604e4ec06 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:58.148141 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c1fa8142-bbef-416a-80b3-a93604e4ec06 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:58.155585 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c1fa8142-bbef-416a-80b3-a93604e4ec06 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.146409 Aug 31 11:43:58.156138 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 82/161] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:58 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:43:58.272252 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-de311207-69e9-4704-a0a6-bcc65417f32b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:58.272962 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-de311207-69e9-4704-a0a6-bcc65417f32b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:58.275591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0b7d746f-b42c-4813-aeaa-2af0600f84fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:58.276237 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0b7d746f-b42c-4813-aeaa-2af0600f84fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:58.279621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-de311207-69e9-4704-a0a6-bcc65417f32b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:58.280102 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-de311207-69e9-4704-a0a6-bcc65417f32b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:58.280555 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-de311207-69e9-4704-a0a6-bcc65417f32b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:58.281295 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-de311207-69e9-4704-a0a6-bcc65417f32b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:58.281748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-de311207-69e9-4704-a0a6-bcc65417f32b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:58.282159 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-de311207-69e9-4704-a0a6-bcc65417f32b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:58.283369 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b7d746f-b42c-4813-aeaa-2af0600f84fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:58.283894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b7d746f-b42c-4813-aeaa-2af0600f84fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:58.285137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b7d746f-b42c-4813-aeaa-2af0600f84fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:58.286019 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b7d746f-b42c-4813-aeaa-2af0600f84fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:58.286477 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b7d746f-b42c-4813-aeaa-2af0600f84fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:58.288402 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b7d746f-b42c-4813-aeaa-2af0600f84fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:58.413792 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-de311207-69e9-4704-a0a6-bcc65417f32b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:58.422232 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-de311207-69e9-4704-a0a6-bcc65417f32b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.154252 Aug 31 11:43:58.422858 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 80/162] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:58 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:58.431556 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0b7d746f-b42c-4813-aeaa-2af0600f84fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:58.439522 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0b7d746f-b42c-4813-aeaa-2af0600f84fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:58.441546 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0b7d746f-b42c-4813-aeaa-2af0600f84fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:58.442654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0b7d746f-b42c-4813-aeaa-2af0600f84fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.171194 Aug 31 11:43:58.443237 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 83/163] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:58 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:43:58.838322 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8543c7be-8264-4be3-be46-58122771f5c0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:58.838923 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8543c7be-8264-4be3-be46-58122771f5c0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:58.844886 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8543c7be-8264-4be3-be46-58122771f5c0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:58.845359 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8543c7be-8264-4be3-be46-58122771f5c0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:58.845784 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8543c7be-8264-4be3-be46-58122771f5c0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:58.846468 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8543c7be-8264-4be3-be46-58122771f5c0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:58.846920 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8543c7be-8264-4be3-be46-58122771f5c0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:58.847337 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8543c7be-8264-4be3-be46-58122771f5c0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:58.865568 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:43:58.983425 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8543c7be-8264-4be3-be46-58122771f5c0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:58.991700 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8543c7be-8264-4be3-be46-58122771f5c0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.157215 Aug 31 11:43:58.992251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 81/164] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:58 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:59.029285 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c1ab0c40-5140-42af-a238-571318a02e41 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:59.029889 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c1ab0c40-5140-42af-a238-571318a02e41 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:59.035785 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1ab0c40-5140-42af-a238-571318a02e41 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:59.036263 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1ab0c40-5140-42af-a238-571318a02e41 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:59.036750 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1ab0c40-5140-42af-a238-571318a02e41 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:59.037423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1ab0c40-5140-42af-a238-571318a02e41 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:59.037867 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1ab0c40-5140-42af-a238-571318a02e41 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:59.038283 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1ab0c40-5140-42af-a238-571318a02e41 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:59.163173 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c1ab0c40-5140-42af-a238-571318a02e41 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:59.170686 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c1ab0c40-5140-42af-a238-571318a02e41 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.145179 Aug 31 11:43:59.171425 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 84/165] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:59 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:59.176809 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-637d0040-c0b4-4447-9bb3-e6dfa502bcb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:59.177406 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-637d0040-c0b4-4447-9bb3-e6dfa502bcb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:59.183248 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-637d0040-c0b4-4447-9bb3-e6dfa502bcb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:59.183658 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-637d0040-c0b4-4447-9bb3-e6dfa502bcb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:59.184076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-637d0040-c0b4-4447-9bb3-e6dfa502bcb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:59.184782 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-637d0040-c0b4-4447-9bb3-e6dfa502bcb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:59.185229 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-637d0040-c0b4-4447-9bb3-e6dfa502bcb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:59.185641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-637d0040-c0b4-4447-9bb3-e6dfa502bcb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:59.321099 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-637d0040-c0b4-4447-9bb3-e6dfa502bcb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:59.328606 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-637d0040-c0b4-4447-9bb3-e6dfa502bcb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.156078 Aug 31 11:43:59.329162 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 82/166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:59 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:59.442422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-40cf1262-256c-4b8e-b0a3-a1b9a60a1ccd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:59.443043 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-40cf1262-256c-4b8e-b0a3-a1b9a60a1ccd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:59.448961 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-40cf1262-256c-4b8e-b0a3-a1b9a60a1ccd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:59.449612 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-40cf1262-256c-4b8e-b0a3-a1b9a60a1ccd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:59.449943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-40cf1262-256c-4b8e-b0a3-a1b9a60a1ccd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:59.450665 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-40cf1262-256c-4b8e-b0a3-a1b9a60a1ccd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:59.451106 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-40cf1262-256c-4b8e-b0a3-a1b9a60a1ccd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:59.451522 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-40cf1262-256c-4b8e-b0a3-a1b9a60a1ccd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:59.464773 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-39e53d8a-72cf-40e1-95ef-8a69f2a84481 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:43:59.465400 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-39e53d8a-72cf-40e1-95ef-8a69f2a84481 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:43:59.471165 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39e53d8a-72cf-40e1-95ef-8a69f2a84481 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:59.472183 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39e53d8a-72cf-40e1-95ef-8a69f2a84481 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:59.472658 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39e53d8a-72cf-40e1-95ef-8a69f2a84481 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:59.473338 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39e53d8a-72cf-40e1-95ef-8a69f2a84481 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:43:59.473783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39e53d8a-72cf-40e1-95ef-8a69f2a84481 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:43:59.474199 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39e53d8a-72cf-40e1-95ef-8a69f2a84481 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:43:59.590077 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-40cf1262-256c-4b8e-b0a3-a1b9a60a1ccd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:59.598128 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-40cf1262-256c-4b8e-b0a3-a1b9a60a1ccd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.159808 Aug 31 11:43:59.598899 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 85/167] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:43:59 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:43:59.610612 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-39e53d8a-72cf-40e1-95ef-8a69f2a84481 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:59.618685 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-39e53d8a-72cf-40e1-95ef-8a69f2a84481 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:59.620117 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-39e53d8a-72cf-40e1-95ef-8a69f2a84481 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:43:59.621231 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-39e53d8a-72cf-40e1-95ef-8a69f2a84481 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.160382 Aug 31 11:43:59.621830 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 83/168] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:43:59 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:44:00.013067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7c164f5d-71f7-4f10-8d43-eb123f6ad1f0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:00.013597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-7c164f5d-71f7-4f10-8d43-eb123f6ad1f0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:00.019898 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c164f5d-71f7-4f10-8d43-eb123f6ad1f0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:00.020413 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c164f5d-71f7-4f10-8d43-eb123f6ad1f0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:00.020879 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c164f5d-71f7-4f10-8d43-eb123f6ad1f0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:00.021563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c164f5d-71f7-4f10-8d43-eb123f6ad1f0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:00.022009 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c164f5d-71f7-4f10-8d43-eb123f6ad1f0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:00.022427 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c164f5d-71f7-4f10-8d43-eb123f6ad1f0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:00.149584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7c164f5d-71f7-4f10-8d43-eb123f6ad1f0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:00.157112 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-7c164f5d-71f7-4f10-8d43-eb123f6ad1f0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.148040 Aug 31 11:44:00.157676 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 86/169] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:00 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:00.192317 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f3e8a2df-a78c-46fc-8cdd-cb013a356549 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:00.192938 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f3e8a2df-a78c-46fc-8cdd-cb013a356549 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:00.198783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3e8a2df-a78c-46fc-8cdd-cb013a356549 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:00.199258 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3e8a2df-a78c-46fc-8cdd-cb013a356549 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:00.199682 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3e8a2df-a78c-46fc-8cdd-cb013a356549 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:00.200352 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3e8a2df-a78c-46fc-8cdd-cb013a356549 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:00.200824 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3e8a2df-a78c-46fc-8cdd-cb013a356549 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:00.201243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3e8a2df-a78c-46fc-8cdd-cb013a356549 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:00.328021 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f3e8a2df-a78c-46fc-8cdd-cb013a356549 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:00.336286 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f3e8a2df-a78c-46fc-8cdd-cb013a356549 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.148565 Aug 31 11:44:00.336911 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 84/170] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:00 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:00.350717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-934bd71a-34c5-43ac-89cf-97b5146cd710 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:00.351617 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-934bd71a-34c5-43ac-89cf-97b5146cd710 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:00.357716 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-934bd71a-34c5-43ac-89cf-97b5146cd710 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:00.358186 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-934bd71a-34c5-43ac-89cf-97b5146cd710 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:00.358702 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-934bd71a-34c5-43ac-89cf-97b5146cd710 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:00.359677 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-934bd71a-34c5-43ac-89cf-97b5146cd710 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:00.360204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-934bd71a-34c5-43ac-89cf-97b5146cd710 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:00.360824 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-934bd71a-34c5-43ac-89cf-97b5146cd710 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:00.496672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-934bd71a-34c5-43ac-89cf-97b5146cd710 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:00.504636 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-934bd71a-34c5-43ac-89cf-97b5146cd710 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.158925 Aug 31 11:44:00.505204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 87/171] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:00 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:00.618836 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-68c9278e-3de3-4af4-96a9-4699d6b64b5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:00.619441 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-68c9278e-3de3-4af4-96a9-4699d6b64b5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:00.625586 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-68c9278e-3de3-4af4-96a9-4699d6b64b5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:00.626074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-68c9278e-3de3-4af4-96a9-4699d6b64b5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:00.626506 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-68c9278e-3de3-4af4-96a9-4699d6b64b5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:00.627191 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-68c9278e-3de3-4af4-96a9-4699d6b64b5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:00.627685 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-68c9278e-3de3-4af4-96a9-4699d6b64b5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:00.628787 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-68c9278e-3de3-4af4-96a9-4699d6b64b5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:00.644416 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-88ea99ee-994f-4977-b16a-aa0aab3b93fa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:00.645064 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-88ea99ee-994f-4977-b16a-aa0aab3b93fa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:00.650925 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88ea99ee-994f-4977-b16a-aa0aab3b93fa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:00.651406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88ea99ee-994f-4977-b16a-aa0aab3b93fa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:00.651836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88ea99ee-994f-4977-b16a-aa0aab3b93fa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:00.652657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88ea99ee-994f-4977-b16a-aa0aab3b93fa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:00.653113 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88ea99ee-994f-4977-b16a-aa0aab3b93fa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:00.653535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88ea99ee-994f-4977-b16a-aa0aab3b93fa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:00.768156 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-68c9278e-3de3-4af4-96a9-4699d6b64b5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:00.777124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-68c9278e-3de3-4af4-96a9-4699d6b64b5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.162016 Aug 31 11:44:00.777896 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 85/172] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:00 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:00.799465 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-88ea99ee-994f-4977-b16a-aa0aab3b93fa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:00.807712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-88ea99ee-994f-4977-b16a-aa0aab3b93fa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:00.809392 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-88ea99ee-994f-4977-b16a-aa0aab3b93fa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:00.810479 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-88ea99ee-994f-4977-b16a-aa0aab3b93fa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.170603 Aug 31 11:44:00.811035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 88/173] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:00 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:01.176789 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-cde9aec6-f457-4000-8b59-650d9e7cf1ac tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:01.177315 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-cde9aec6-f457-4000-8b59-650d9e7cf1ac tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:01.183562 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cde9aec6-f457-4000-8b59-650d9e7cf1ac tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:01.184033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cde9aec6-f457-4000-8b59-650d9e7cf1ac tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:01.184461 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cde9aec6-f457-4000-8b59-650d9e7cf1ac tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:01.185164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cde9aec6-f457-4000-8b59-650d9e7cf1ac tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:01.185609 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cde9aec6-f457-4000-8b59-650d9e7cf1ac tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:01.186027 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cde9aec6-f457-4000-8b59-650d9e7cf1ac tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:01.311879 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-cde9aec6-f457-4000-8b59-650d9e7cf1ac tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:01.320284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-cde9aec6-f457-4000-8b59-650d9e7cf1ac tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.147521 Aug 31 11:44:01.320870 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 86/174] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:01 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:01.357241 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1b7bf96e-93f1-4560-8839-738424c70a71 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:01.357851 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1b7bf96e-93f1-4560-8839-738424c70a71 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:01.364416 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b7bf96e-93f1-4560-8839-738424c70a71 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:01.364934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b7bf96e-93f1-4560-8839-738424c70a71 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:01.365365 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b7bf96e-93f1-4560-8839-738424c70a71 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:01.366054 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b7bf96e-93f1-4560-8839-738424c70a71 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:01.366503 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b7bf96e-93f1-4560-8839-738424c70a71 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:01.366925 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b7bf96e-93f1-4560-8839-738424c70a71 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:01.494522 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1b7bf96e-93f1-4560-8839-738424c70a71 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:01.502304 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1b7bf96e-93f1-4560-8839-738424c70a71 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.148823 Aug 31 11:44:01.503336 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 89/175] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:01 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:01.524712 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b6c8d3b2-04cf-44ce-81d3-4e38e6d68707 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:01.525317 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b6c8d3b2-04cf-44ce-81d3-4e38e6d68707 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:01.531116 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b6c8d3b2-04cf-44ce-81d3-4e38e6d68707 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:01.531592 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b6c8d3b2-04cf-44ce-81d3-4e38e6d68707 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:01.532021 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b6c8d3b2-04cf-44ce-81d3-4e38e6d68707 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:01.532726 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b6c8d3b2-04cf-44ce-81d3-4e38e6d68707 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:01.533175 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b6c8d3b2-04cf-44ce-81d3-4e38e6d68707 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:01.533597 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b6c8d3b2-04cf-44ce-81d3-4e38e6d68707 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:01.658896 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b6c8d3b2-04cf-44ce-81d3-4e38e6d68707 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:01.666427 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b6c8d3b2-04cf-44ce-81d3-4e38e6d68707 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.145518 Aug 31 11:44:01.666988 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 87/176] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:01 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:01.797309 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-de9354dd-960f-4ce1-8694-fa79b743c7dc tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:01.797833 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-de9354dd-960f-4ce1-8694-fa79b743c7dc tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:01.804234 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-de9354dd-960f-4ce1-8694-fa79b743c7dc tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:01.804824 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-de9354dd-960f-4ce1-8694-fa79b743c7dc tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:01.805256 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-de9354dd-960f-4ce1-8694-fa79b743c7dc tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:01.805934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-de9354dd-960f-4ce1-8694-fa79b743c7dc tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:01.806380 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-de9354dd-960f-4ce1-8694-fa79b743c7dc tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:01.806822 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-de9354dd-960f-4ce1-8694-fa79b743c7dc tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:01.833526 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ac80d799-e0b7-4745-817a-f64ad6e31832 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:01.834122 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ac80d799-e0b7-4745-817a-f64ad6e31832 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:01.840113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac80d799-e0b7-4745-817a-f64ad6e31832 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:01.840623 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac80d799-e0b7-4745-817a-f64ad6e31832 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:01.841059 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac80d799-e0b7-4745-817a-f64ad6e31832 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:01.841739 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac80d799-e0b7-4745-817a-f64ad6e31832 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:01.842182 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac80d799-e0b7-4745-817a-f64ad6e31832 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:01.842600 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac80d799-e0b7-4745-817a-f64ad6e31832 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:01.939375 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-de9354dd-960f-4ce1-8694-fa79b743c7dc tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:01.947968 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-de9354dd-960f-4ce1-8694-fa79b743c7dc tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.154432 Aug 31 11:44:01.948655 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 90/177] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:01 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:01.982174 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ac80d799-e0b7-4745-817a-f64ad6e31832 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:01.990830 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ac80d799-e0b7-4745-817a-f64ad6e31832 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:01.992262 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ac80d799-e0b7-4745-817a-f64ad6e31832 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:01.993384 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ac80d799-e0b7-4745-817a-f64ad6e31832 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.163741 Aug 31 11:44:01.993934 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 88/178] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:01 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:44:02.341419 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-fd5c72a4-e184-40d7-91f8-145e2620df0e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:02.342022 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-fd5c72a4-e184-40d7-91f8-145e2620df0e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:02.348637 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd5c72a4-e184-40d7-91f8-145e2620df0e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:02.349115 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd5c72a4-e184-40d7-91f8-145e2620df0e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:02.349541 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd5c72a4-e184-40d7-91f8-145e2620df0e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:02.350220 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd5c72a4-e184-40d7-91f8-145e2620df0e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:02.350666 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd5c72a4-e184-40d7-91f8-145e2620df0e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:02.351083 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd5c72a4-e184-40d7-91f8-145e2620df0e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:02.476894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-fd5c72a4-e184-40d7-91f8-145e2620df0e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:02.484381 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-fd5c72a4-e184-40d7-91f8-145e2620df0e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.146842 Aug 31 11:44:02.484966 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 91/179] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:02 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:02.523574 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-25a7049d-1b52-449b-9f34-e2126a3df194 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:02.524204 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-25a7049d-1b52-449b-9f34-e2126a3df194 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:02.530387 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-25a7049d-1b52-449b-9f34-e2126a3df194 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:02.530925 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-25a7049d-1b52-449b-9f34-e2126a3df194 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:02.531351 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-25a7049d-1b52-449b-9f34-e2126a3df194 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:02.532025 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-25a7049d-1b52-449b-9f34-e2126a3df194 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:02.532516 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-25a7049d-1b52-449b-9f34-e2126a3df194 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:02.532926 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-25a7049d-1b52-449b-9f34-e2126a3df194 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:02.665879 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-25a7049d-1b52-449b-9f34-e2126a3df194 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:02.673768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-25a7049d-1b52-449b-9f34-e2126a3df194 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.153978 Aug 31 11:44:02.674331 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 89/180] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:02 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:02.687055 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1eab073b-9e49-47b8-9044-92b088387b58 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:02.687661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1eab073b-9e49-47b8-9044-92b088387b58 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:02.694661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1eab073b-9e49-47b8-9044-92b088387b58 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:02.695140 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1eab073b-9e49-47b8-9044-92b088387b58 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:02.695611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1eab073b-9e49-47b8-9044-92b088387b58 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:02.696361 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1eab073b-9e49-47b8-9044-92b088387b58 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:02.696848 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1eab073b-9e49-47b8-9044-92b088387b58 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:02.697274 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1eab073b-9e49-47b8-9044-92b088387b58 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:02.822911 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1eab073b-9e49-47b8-9044-92b088387b58 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:02.830336 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1eab073b-9e49-47b8-9044-92b088387b58 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.147151 Aug 31 11:44:02.831552 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 92/181] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:02 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:02.970960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b3715735-1a84-4534-b8b6-62c9b1203921 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:02.971659 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b3715735-1a84-4534-b8b6-62c9b1203921 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:02.977573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b3715735-1a84-4534-b8b6-62c9b1203921 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:02.978071 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b3715735-1a84-4534-b8b6-62c9b1203921 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:02.978497 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b3715735-1a84-4534-b8b6-62c9b1203921 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:02.979162 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b3715735-1a84-4534-b8b6-62c9b1203921 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:02.979599 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b3715735-1a84-4534-b8b6-62c9b1203921 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:02.980010 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b3715735-1a84-4534-b8b6-62c9b1203921 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:03.015245 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2cb7ef8f-51ee-40bb-9f42-99e16dbb3e10 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:03.015880 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2cb7ef8f-51ee-40bb-9f42-99e16dbb3e10 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:03.021934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2cb7ef8f-51ee-40bb-9f42-99e16dbb3e10 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:03.022415 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2cb7ef8f-51ee-40bb-9f42-99e16dbb3e10 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:03.022841 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2cb7ef8f-51ee-40bb-9f42-99e16dbb3e10 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:03.023529 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2cb7ef8f-51ee-40bb-9f42-99e16dbb3e10 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:03.023976 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2cb7ef8f-51ee-40bb-9f42-99e16dbb3e10 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:03.024401 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2cb7ef8f-51ee-40bb-9f42-99e16dbb3e10 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:03.112631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b3715735-1a84-4534-b8b6-62c9b1203921 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:03.120670 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b3715735-1a84-4534-b8b6-62c9b1203921 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.153476 Aug 31 11:44:03.121330 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 90/182] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:02 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:03.161446 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2cb7ef8f-51ee-40bb-9f42-99e16dbb3e10 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:03.169785 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2cb7ef8f-51ee-40bb-9f42-99e16dbb3e10 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:03.171371 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2cb7ef8f-51ee-40bb-9f42-99e16dbb3e10 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:03.172541 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2cb7ef8f-51ee-40bb-9f42-99e16dbb3e10 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.160905 Aug 31 11:44:03.173208 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 93/183] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:03 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:44:03.505066 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-eec0dad1-2b67-4030-b748-900f161aa8b9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:03.505671 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-eec0dad1-2b67-4030-b748-900f161aa8b9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:03.511529 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eec0dad1-2b67-4030-b748-900f161aa8b9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:03.512085 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eec0dad1-2b67-4030-b748-900f161aa8b9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:03.512426 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eec0dad1-2b67-4030-b748-900f161aa8b9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:03.513145 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eec0dad1-2b67-4030-b748-900f161aa8b9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:03.513591 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eec0dad1-2b67-4030-b748-900f161aa8b9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:03.514011 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eec0dad1-2b67-4030-b748-900f161aa8b9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:03.641341 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-eec0dad1-2b67-4030-b748-900f161aa8b9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:03.650377 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-eec0dad1-2b67-4030-b748-900f161aa8b9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.149208 Aug 31 11:44:03.650940 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 91/184] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:03 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:03.695589 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cd85b2c2-610a-4242-88d3-f8805e15578a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:03.696196 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cd85b2c2-610a-4242-88d3-f8805e15578a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:03.702119 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cd85b2c2-610a-4242-88d3-f8805e15578a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:03.702598 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cd85b2c2-610a-4242-88d3-f8805e15578a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:03.703032 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cd85b2c2-610a-4242-88d3-f8805e15578a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:03.703709 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cd85b2c2-610a-4242-88d3-f8805e15578a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:03.704158 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cd85b2c2-610a-4242-88d3-f8805e15578a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:03.704620 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cd85b2c2-610a-4242-88d3-f8805e15578a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:03.831805 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cd85b2c2-610a-4242-88d3-f8805e15578a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:03.839400 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cd85b2c2-610a-4242-88d3-f8805e15578a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.147675 Aug 31 11:44:03.839989 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 94/185] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:03 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:03.851775 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e0c551e9-e0fa-4f1e-99bd-95078f56560b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:03.852379 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e0c551e9-e0fa-4f1e-99bd-95078f56560b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:03.858283 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e0c551e9-e0fa-4f1e-99bd-95078f56560b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:03.858758 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e0c551e9-e0fa-4f1e-99bd-95078f56560b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:03.859195 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e0c551e9-e0fa-4f1e-99bd-95078f56560b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:03.859874 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e0c551e9-e0fa-4f1e-99bd-95078f56560b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:03.860322 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e0c551e9-e0fa-4f1e-99bd-95078f56560b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:03.860767 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e0c551e9-e0fa-4f1e-99bd-95078f56560b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:03.990659 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e0c551e9-e0fa-4f1e-99bd-95078f56560b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:03.998150 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e0c551e9-e0fa-4f1e-99bd-95078f56560b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.150752 Aug 31 11:44:03.998709 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 92/186] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:03 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:04.142205 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-dd0ee6db-6b7e-428b-a365-3c3a81469528 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:04.142806 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-dd0ee6db-6b7e-428b-a365-3c3a81469528 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:04.148756 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd0ee6db-6b7e-428b-a365-3c3a81469528 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:04.149237 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd0ee6db-6b7e-428b-a365-3c3a81469528 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:04.149665 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd0ee6db-6b7e-428b-a365-3c3a81469528 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:04.150341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd0ee6db-6b7e-428b-a365-3c3a81469528 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:04.150786 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd0ee6db-6b7e-428b-a365-3c3a81469528 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:04.151203 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd0ee6db-6b7e-428b-a365-3c3a81469528 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:04.195465 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7ce7a1cc-d854-40d2-895c-a877ab3f3ab9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:04.195967 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7ce7a1cc-d854-40d2-895c-a877ab3f3ab9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:04.201785 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7ce7a1cc-d854-40d2-895c-a877ab3f3ab9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:04.202258 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7ce7a1cc-d854-40d2-895c-a877ab3f3ab9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:04.202677 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7ce7a1cc-d854-40d2-895c-a877ab3f3ab9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:04.203341 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7ce7a1cc-d854-40d2-895c-a877ab3f3ab9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:04.203778 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7ce7a1cc-d854-40d2-895c-a877ab3f3ab9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:04.204188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7ce7a1cc-d854-40d2-895c-a877ab3f3ab9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:04.347878 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7ce7a1cc-d854-40d2-895c-a877ab3f3ab9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:04.356352 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7ce7a1cc-d854-40d2-895c-a877ab3f3ab9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:04.357832 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7ce7a1cc-d854-40d2-895c-a877ab3f3ab9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:04.358950 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7ce7a1cc-d854-40d2-895c-a877ab3f3ab9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.167466 Aug 31 11:44:04.359507 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 93/187] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:04 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:44:04.446511 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-dd0ee6db-6b7e-428b-a365-3c3a81469528 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:04.454110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-dd0ee6db-6b7e-428b-a365-3c3a81469528 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.315654 Aug 31 11:44:04.454673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 95/188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:04 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:04.670625 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3e774cf2-b37d-40c6-97a7-ace94aacabb6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:04.671224 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3e774cf2-b37d-40c6-97a7-ace94aacabb6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:04.677292 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3e774cf2-b37d-40c6-97a7-ace94aacabb6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:04.677773 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3e774cf2-b37d-40c6-97a7-ace94aacabb6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:04.678204 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3e774cf2-b37d-40c6-97a7-ace94aacabb6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:04.678893 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3e774cf2-b37d-40c6-97a7-ace94aacabb6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:04.679343 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3e774cf2-b37d-40c6-97a7-ace94aacabb6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:04.679763 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3e774cf2-b37d-40c6-97a7-ace94aacabb6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:04.806119 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3e774cf2-b37d-40c6-97a7-ace94aacabb6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:04.813724 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3e774cf2-b37d-40c6-97a7-ace94aacabb6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.146856 Aug 31 11:44:04.814283 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 94/189] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:04 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:04.861455 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-55a23859-32ab-4e0c-b680-0972a13cf0a5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:04.862087 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-55a23859-32ab-4e0c-b680-0972a13cf0a5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:04.868312 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-55a23859-32ab-4e0c-b680-0972a13cf0a5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:04.868826 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-55a23859-32ab-4e0c-b680-0972a13cf0a5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:04.869254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-55a23859-32ab-4e0c-b680-0972a13cf0a5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:04.869925 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-55a23859-32ab-4e0c-b680-0972a13cf0a5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:04.870370 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-55a23859-32ab-4e0c-b680-0972a13cf0a5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:04.870802 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-55a23859-32ab-4e0c-b680-0972a13cf0a5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:04.997867 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-55a23859-32ab-4e0c-b680-0972a13cf0a5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:05.006137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-55a23859-32ab-4e0c-b680-0972a13cf0a5 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.148404 Aug 31 11:44:05.006640 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 96/190] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:04 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:05.019554 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d9471987-a275-4f0f-a1fb-a457a7b45611 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:05.020140 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d9471987-a275-4f0f-a1fb-a457a7b45611 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:05.026130 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d9471987-a275-4f0f-a1fb-a457a7b45611 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:05.026621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d9471987-a275-4f0f-a1fb-a457a7b45611 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:05.027028 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d9471987-a275-4f0f-a1fb-a457a7b45611 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:05.027706 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d9471987-a275-4f0f-a1fb-a457a7b45611 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:05.028143 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d9471987-a275-4f0f-a1fb-a457a7b45611 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:05.028582 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d9471987-a275-4f0f-a1fb-a457a7b45611 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:05.159320 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d9471987-a275-4f0f-a1fb-a457a7b45611 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:05.166906 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d9471987-a275-4f0f-a1fb-a457a7b45611 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.151752 Aug 31 11:44:05.167475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 95/191] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:05 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:05.382177 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5ef4b1db-0e8b-4f20-8798-b842a41ca36b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:05.382782 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5ef4b1db-0e8b-4f20-8798-b842a41ca36b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:05.388714 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ef4b1db-0e8b-4f20-8798-b842a41ca36b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:05.389193 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ef4b1db-0e8b-4f20-8798-b842a41ca36b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:05.389630 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ef4b1db-0e8b-4f20-8798-b842a41ca36b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:05.390310 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ef4b1db-0e8b-4f20-8798-b842a41ca36b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:05.390767 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ef4b1db-0e8b-4f20-8798-b842a41ca36b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:05.391189 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ef4b1db-0e8b-4f20-8798-b842a41ca36b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:05.396348 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:05.475642 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ada3aade-7127-4ed6-bc1b-b6392916820f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:05.476828 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ada3aade-7127-4ed6-bc1b-b6392916820f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:05.483783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ada3aade-7127-4ed6-bc1b-b6392916820f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:05.484375 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ada3aade-7127-4ed6-bc1b-b6392916820f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:05.485052 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ada3aade-7127-4ed6-bc1b-b6392916820f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:05.485825 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ada3aade-7127-4ed6-bc1b-b6392916820f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:05.486579 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ada3aade-7127-4ed6-bc1b-b6392916820f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:05.487759 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ada3aade-7127-4ed6-bc1b-b6392916820f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:05.671238 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ada3aade-7127-4ed6-bc1b-b6392916820f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:05.682911 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ada3aade-7127-4ed6-bc1b-b6392916820f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.208589 Aug 31 11:44:05.692787 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 96/192] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:05 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:05.746436 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5ef4b1db-0e8b-4f20-8798-b842a41ca36b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:05.754596 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5ef4b1db-0e8b-4f20-8798-b842a41ca36b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:05.756029 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5ef4b1db-0e8b-4f20-8798-b842a41ca36b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:05.757197 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5ef4b1db-0e8b-4f20-8798-b842a41ca36b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.379697 Aug 31 11:44:05.757747 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 97/193] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:05 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:05.836046 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2506c47e-2a1d-4c4a-b75b-1bee3df3c411 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:05.836732 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2506c47e-2a1d-4c4a-b75b-1bee3df3c411 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:05.843115 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2506c47e-2a1d-4c4a-b75b-1bee3df3c411 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:05.843594 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2506c47e-2a1d-4c4a-b75b-1bee3df3c411 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:05.844025 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2506c47e-2a1d-4c4a-b75b-1bee3df3c411 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:05.844804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2506c47e-2a1d-4c4a-b75b-1bee3df3c411 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:05.845252 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2506c47e-2a1d-4c4a-b75b-1bee3df3c411 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:05.845738 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2506c47e-2a1d-4c4a-b75b-1bee3df3c411 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:05.983923 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2506c47e-2a1d-4c4a-b75b-1bee3df3c411 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:05.991702 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2506c47e-2a1d-4c4a-b75b-1bee3df3c411 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.161060 Aug 31 11:44:05.992319 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 97/194] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:05 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:06.029024 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4c8de672-2902-4af5-b73a-542866586c92 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:06.030670 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4c8de672-2902-4af5-b73a-542866586c92 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:06.044364 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4c8de672-2902-4af5-b73a-542866586c92 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:06.052697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4c8de672-2902-4af5-b73a-542866586c92 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:06.053286 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4c8de672-2902-4af5-b73a-542866586c92 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:06.054279 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4c8de672-2902-4af5-b73a-542866586c92 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:06.057064 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4c8de672-2902-4af5-b73a-542866586c92 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:06.060981 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4c8de672-2902-4af5-b73a-542866586c92 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:06.191488 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4545bfbb-ebbc-4875-b43d-5f1eb2d39cd8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:06.192618 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4545bfbb-ebbc-4875-b43d-5f1eb2d39cd8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:06.200633 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4545bfbb-ebbc-4875-b43d-5f1eb2d39cd8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:06.202738 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4545bfbb-ebbc-4875-b43d-5f1eb2d39cd8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:06.203382 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4545bfbb-ebbc-4875-b43d-5f1eb2d39cd8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:06.204310 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4545bfbb-ebbc-4875-b43d-5f1eb2d39cd8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:06.205183 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4545bfbb-ebbc-4875-b43d-5f1eb2d39cd8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:06.206511 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4545bfbb-ebbc-4875-b43d-5f1eb2d39cd8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:06.214628 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:06.295631 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4c8de672-2902-4af5-b73a-542866586c92 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:06.303539 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4c8de672-2902-4af5-b73a-542866586c92 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.278740 Aug 31 11:44:06.304664 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 98/195] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:06 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:06.388216 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4545bfbb-ebbc-4875-b43d-5f1eb2d39cd8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:06.397884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4545bfbb-ebbc-4875-b43d-5f1eb2d39cd8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.214546 Aug 31 11:44:06.398453 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 98/196] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:06 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:06.701526 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-925c6274-6745-49fc-9c57-b7db276015c8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:06.702214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-925c6274-6745-49fc-9c57-b7db276015c8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:06.708952 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-925c6274-6745-49fc-9c57-b7db276015c8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:06.709542 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-925c6274-6745-49fc-9c57-b7db276015c8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:06.710036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-925c6274-6745-49fc-9c57-b7db276015c8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:06.710867 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-925c6274-6745-49fc-9c57-b7db276015c8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:06.711488 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-925c6274-6745-49fc-9c57-b7db276015c8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:06.711972 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-925c6274-6745-49fc-9c57-b7db276015c8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:06.778986 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c2dba650-0f5b-42c7-b7cd-a2dbd90f096f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:06.779586 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c2dba650-0f5b-42c7-b7cd-a2dbd90f096f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:06.786795 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c2dba650-0f5b-42c7-b7cd-a2dbd90f096f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:06.787283 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c2dba650-0f5b-42c7-b7cd-a2dbd90f096f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:06.787716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c2dba650-0f5b-42c7-b7cd-a2dbd90f096f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:06.788404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c2dba650-0f5b-42c7-b7cd-a2dbd90f096f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:06.788874 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c2dba650-0f5b-42c7-b7cd-a2dbd90f096f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:06.789293 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c2dba650-0f5b-42c7-b7cd-a2dbd90f096f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:06.861815 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-925c6274-6745-49fc-9c57-b7db276015c8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:06.870488 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-925c6274-6745-49fc-9c57-b7db276015c8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.173016 Aug 31 11:44:06.871061 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 99/197] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:06 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:06.925620 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c2dba650-0f5b-42c7-b7cd-a2dbd90f096f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:06.934095 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c2dba650-0f5b-42c7-b7cd-a2dbd90f096f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:06.935860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c2dba650-0f5b-42c7-b7cd-a2dbd90f096f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:06.936997 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c2dba650-0f5b-42c7-b7cd-a2dbd90f096f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.161857 Aug 31 11:44:06.937554 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 99/198] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:06 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:44:07.012241 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d5a56bd6-fd39-4f5e-acb2-d467b43b09d0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:07.012867 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d5a56bd6-fd39-4f5e-acb2-d467b43b09d0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:07.019100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d5a56bd6-fd39-4f5e-acb2-d467b43b09d0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:07.019960 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d5a56bd6-fd39-4f5e-acb2-d467b43b09d0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:07.020941 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d5a56bd6-fd39-4f5e-acb2-d467b43b09d0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:07.021667 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d5a56bd6-fd39-4f5e-acb2-d467b43b09d0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:07.022138 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d5a56bd6-fd39-4f5e-acb2-d467b43b09d0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:07.023148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d5a56bd6-fd39-4f5e-acb2-d467b43b09d0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:07.156151 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d5a56bd6-fd39-4f5e-acb2-d467b43b09d0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:07.164215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d5a56bd6-fd39-4f5e-acb2-d467b43b09d0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.155797 Aug 31 11:44:07.164803 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 100/199] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:07 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:07.326760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6264d63b-58ec-4134-97d4-32b8dc6036ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:07.327327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6264d63b-58ec-4134-97d4-32b8dc6036ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:07.334026 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6264d63b-58ec-4134-97d4-32b8dc6036ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:07.334505 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6264d63b-58ec-4134-97d4-32b8dc6036ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:07.334935 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6264d63b-58ec-4134-97d4-32b8dc6036ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:07.335619 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6264d63b-58ec-4134-97d4-32b8dc6036ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:07.336082 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6264d63b-58ec-4134-97d4-32b8dc6036ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:07.336527 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6264d63b-58ec-4134-97d4-32b8dc6036ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:07.419369 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-90ee35f2-2904-42f9-b05c-cc26e1e1eb8b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:07.419982 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-90ee35f2-2904-42f9-b05c-cc26e1e1eb8b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:07.426590 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-90ee35f2-2904-42f9-b05c-cc26e1e1eb8b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:07.427075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-90ee35f2-2904-42f9-b05c-cc26e1e1eb8b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:07.427506 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-90ee35f2-2904-42f9-b05c-cc26e1e1eb8b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:07.428195 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-90ee35f2-2904-42f9-b05c-cc26e1e1eb8b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:07.428676 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-90ee35f2-2904-42f9-b05c-cc26e1e1eb8b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:07.429097 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-90ee35f2-2904-42f9-b05c-cc26e1e1eb8b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:07.480053 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6264d63b-58ec-4134-97d4-32b8dc6036ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:07.488826 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6264d63b-58ec-4134-97d4-32b8dc6036ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.165828 Aug 31 11:44:07.489766 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 100/200] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:07 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:07.566117 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-90ee35f2-2904-42f9-b05c-cc26e1e1eb8b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:07.574059 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-90ee35f2-2904-42f9-b05c-cc26e1e1eb8b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.158484 Aug 31 11:44:07.574619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 101/201] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:07 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:07.892006 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ca4bbe8a-d8e0-46af-b4d2-3b8e6fbed00b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:07.892726 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ca4bbe8a-d8e0-46af-b4d2-3b8e6fbed00b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:07.898753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca4bbe8a-d8e0-46af-b4d2-3b8e6fbed00b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:07.899239 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca4bbe8a-d8e0-46af-b4d2-3b8e6fbed00b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:07.899682 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca4bbe8a-d8e0-46af-b4d2-3b8e6fbed00b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:07.900423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca4bbe8a-d8e0-46af-b4d2-3b8e6fbed00b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:07.901003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca4bbe8a-d8e0-46af-b4d2-3b8e6fbed00b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:07.901430 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca4bbe8a-d8e0-46af-b4d2-3b8e6fbed00b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:07.961701 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-df7639ae-cd38-47b6-90c1-1cb729528e7d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:07.962288 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-df7639ae-cd38-47b6-90c1-1cb729528e7d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:07.968704 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-df7639ae-cd38-47b6-90c1-1cb729528e7d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:07.969403 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-df7639ae-cd38-47b6-90c1-1cb729528e7d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:07.969958 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-df7639ae-cd38-47b6-90c1-1cb729528e7d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:07.970862 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-df7639ae-cd38-47b6-90c1-1cb729528e7d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:07.972200 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-df7639ae-cd38-47b6-90c1-1cb729528e7d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:07.972971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-df7639ae-cd38-47b6-90c1-1cb729528e7d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:08.060682 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ca4bbe8a-d8e0-46af-b4d2-3b8e6fbed00b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:08.073052 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ca4bbe8a-d8e0-46af-b4d2-3b8e6fbed00b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.183364 Aug 31 11:44:08.076538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 101/202] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:07 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:08.148988 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-df7639ae-cd38-47b6-90c1-1cb729528e7d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:08.158167 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-df7639ae-cd38-47b6-90c1-1cb729528e7d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:08.159962 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-df7639ae-cd38-47b6-90c1-1cb729528e7d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:08.161107 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-df7639ae-cd38-47b6-90c1-1cb729528e7d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.204406 Aug 31 11:44:08.161664 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 102/203] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:07 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:44:08.175885 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-9cff61a1-d396-4c00-ba2f-ba9b166abec9 req-3708bc9a-d0b5-42e4-bb86-b66ecde1f519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06215e54-27bb-4685-9a34-14109d73c81e", "name": "network-vif-plugged", "status": "completed", "tag": "c4e2bf04-c687-4686-9210-e0be89d06923"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:44:08.184851 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-80124a36-a923-4ebd-9366-9810ecc304c5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:08.185445 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-80124a36-a923-4ebd-9366-9810ecc304c5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:08.188296 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-9cff61a1-d396-4c00-ba2f-ba9b166abec9 req-3708bc9a-d0b5-42e4-bb86-b66ecde1f519 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:08.188879 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-9cff61a1-d396-4c00-ba2f-ba9b166abec9 req-3708bc9a-d0b5-42e4-bb86-b66ecde1f519 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:08.189388 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-9cff61a1-d396-4c00-ba2f-ba9b166abec9 req-3708bc9a-d0b5-42e4-bb86-b66ecde1f519 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:08.192076 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-80124a36-a923-4ebd-9366-9810ecc304c5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:08.192572 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-80124a36-a923-4ebd-9366-9810ecc304c5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:08.192999 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-80124a36-a923-4ebd-9366-9810ecc304c5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:08.193844 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-80124a36-a923-4ebd-9366-9810ecc304c5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:08.194291 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-80124a36-a923-4ebd-9366-9810ecc304c5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:08.194706 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-80124a36-a923-4ebd-9366-9810ecc304c5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:08.210183 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-9cff61a1-d396-4c00-ba2f-ba9b166abec9 req-3708bc9a-d0b5-42e4-bb86-b66ecde1f519 service nova] Creating event network-vif-plugged:c4e2bf04-c687-4686-9210-e0be89d06923 for instance 06215e54-27bb-4685-9a34-14109d73c81e on hv-cinder-83976 Aug 31 11:44:08.210704 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-9cff61a1-d396-4c00-ba2f-ba9b166abec9 req-3708bc9a-d0b5-42e4-bb86-b66ecde1f519 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127061) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 11:44:08.211091 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-9cff61a1-d396-4c00-ba2f-ba9b166abec9 req-3708bc9a-d0b5-42e4-bb86-b66ecde1f519 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127061) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 11:44:08.212093 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3eac2-b4f1-426a-8b0f-f2dcc12252d2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:08.212584 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3eac2-b4f1-426a-8b0f-f2dcc12252d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:08.213009 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3eac2-b4f1-426a-8b0f-f2dcc12252d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:08.213708 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3eac2-b4f1-426a-8b0f-f2dcc12252d2 None None] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:08.214150 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3eac2-b4f1-426a-8b0f-f2dcc12252d2 None None] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:08.214558 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3eac2-b4f1-426a-8b0f-f2dcc12252d2 None None] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:08.223836 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.compute.rpcapi [None req-6ac3eac2-b4f1-426a-8b0f-f2dcc12252d2 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 11:44:08.224826 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3eac2-b4f1-426a-8b0f-f2dcc12252d2 None None] Releasing lock "compute-rpcapi-router" {{(pid=127061) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 11:44:08.241272 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6ac3eac2-b4f1-426a-8b0f-f2dcc12252d2 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130711 Aug 31 11:44:08.241873 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 102/204] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:44:08.329251 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-80124a36-a923-4ebd-9366-9810ecc304c5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:08.337159 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-80124a36-a923-4ebd-9366-9810ecc304c5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.155906 Aug 31 11:44:08.338010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 103/205] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:08 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:08.510952 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3cb1a191-779a-45ad-9027-243c7f29bc42 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:08.511647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3cb1a191-779a-45ad-9027-243c7f29bc42 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:08.517865 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3cb1a191-779a-45ad-9027-243c7f29bc42 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:08.518464 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3cb1a191-779a-45ad-9027-243c7f29bc42 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:08.518895 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3cb1a191-779a-45ad-9027-243c7f29bc42 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:08.519584 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3cb1a191-779a-45ad-9027-243c7f29bc42 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:08.520030 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3cb1a191-779a-45ad-9027-243c7f29bc42 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:08.520448 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3cb1a191-779a-45ad-9027-243c7f29bc42 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:08.595277 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-edfb303b-a4e2-4e85-ae6b-a8701e84bebd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:08.596780 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-edfb303b-a4e2-4e85-ae6b-a8701e84bebd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:08.604630 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-edfb303b-a4e2-4e85-ae6b-a8701e84bebd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:08.605111 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-edfb303b-a4e2-4e85-ae6b-a8701e84bebd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:08.605839 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-edfb303b-a4e2-4e85-ae6b-a8701e84bebd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:08.606736 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-edfb303b-a4e2-4e85-ae6b-a8701e84bebd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:08.607181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-edfb303b-a4e2-4e85-ae6b-a8701e84bebd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:08.607603 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-edfb303b-a4e2-4e85-ae6b-a8701e84bebd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:08.660850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3cb1a191-779a-45ad-9027-243c7f29bc42 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:08.668424 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3cb1a191-779a-45ad-9027-243c7f29bc42 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.162211 Aug 31 11:44:08.676624 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 103/206] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:08 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:08.767948 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-edfb303b-a4e2-4e85-ae6b-a8701e84bebd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:08.781803 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-edfb303b-a4e2-4e85-ae6b-a8701e84bebd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.191030 Aug 31 11:44:08.785415 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 104/207] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:08 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:09.095576 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-29e48f74-6718-409e-ae92-97b54c3d0978 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:09.097301 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-29e48f74-6718-409e-ae92-97b54c3d0978 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:09.103369 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29e48f74-6718-409e-ae92-97b54c3d0978 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:09.103854 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29e48f74-6718-409e-ae92-97b54c3d0978 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:09.104290 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29e48f74-6718-409e-ae92-97b54c3d0978 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:09.105005 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29e48f74-6718-409e-ae92-97b54c3d0978 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:09.105456 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29e48f74-6718-409e-ae92-97b54c3d0978 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:09.105877 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29e48f74-6718-409e-ae92-97b54c3d0978 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:09.183442 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-11bbc86a-ef73-498a-b1fe-5b4144158545 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:09.184039 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-11bbc86a-ef73-498a-b1fe-5b4144158545 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:09.191240 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11bbc86a-ef73-498a-b1fe-5b4144158545 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:09.191725 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11bbc86a-ef73-498a-b1fe-5b4144158545 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:09.192360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11bbc86a-ef73-498a-b1fe-5b4144158545 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:09.193247 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11bbc86a-ef73-498a-b1fe-5b4144158545 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:09.193696 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11bbc86a-ef73-498a-b1fe-5b4144158545 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:09.194114 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11bbc86a-ef73-498a-b1fe-5b4144158545 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:09.337515 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-11bbc86a-ef73-498a-b1fe-5b4144158545 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:09.346945 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-11bbc86a-ef73-498a-b1fe-5b4144158545 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:09.348465 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-11bbc86a-ef73-498a-b1fe-5b4144158545 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:09.349620 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-11bbc86a-ef73-498a-b1fe-5b4144158545 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.170228 Aug 31 11:44:09.350173 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 105/208] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:09 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:44:09.364985 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f9a8fa71-0245-4fac-8c50-9589670532f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:09.365905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f9a8fa71-0245-4fac-8c50-9589670532f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:09.371942 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f9a8fa71-0245-4fac-8c50-9589670532f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:09.372442 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f9a8fa71-0245-4fac-8c50-9589670532f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:09.373051 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f9a8fa71-0245-4fac-8c50-9589670532f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:09.373739 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f9a8fa71-0245-4fac-8c50-9589670532f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:09.374220 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f9a8fa71-0245-4fac-8c50-9589670532f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:09.374812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f9a8fa71-0245-4fac-8c50-9589670532f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:09.449436 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-29e48f74-6718-409e-ae92-97b54c3d0978 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:09.458763 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-29e48f74-6718-409e-ae92-97b54c3d0978 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.367081 Aug 31 11:44:09.459352 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 104/209] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:09 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:09.522113 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f9a8fa71-0245-4fac-8c50-9589670532f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:09.530158 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f9a8fa71-0245-4fac-8c50-9589670532f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.175030 Aug 31 11:44:09.530718 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 106/210] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:09 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:09.689103 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6788435b-e69d-4886-961c-3171e0de49fc tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:09.689703 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6788435b-e69d-4886-961c-3171e0de49fc tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:09.696405 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6788435b-e69d-4886-961c-3171e0de49fc tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:09.696846 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6788435b-e69d-4886-961c-3171e0de49fc tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:09.697278 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6788435b-e69d-4886-961c-3171e0de49fc tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:09.697952 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6788435b-e69d-4886-961c-3171e0de49fc tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:09.698405 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6788435b-e69d-4886-961c-3171e0de49fc tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:09.698824 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6788435b-e69d-4886-961c-3171e0de49fc tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:09.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-88c81aef-11a4-48b1-afb2-8edbdb2242ef tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:09.807767 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-88c81aef-11a4-48b1-afb2-8edbdb2242ef tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:09.814296 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88c81aef-11a4-48b1-afb2-8edbdb2242ef tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:09.814774 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88c81aef-11a4-48b1-afb2-8edbdb2242ef tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:09.816312 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88c81aef-11a4-48b1-afb2-8edbdb2242ef tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:09.817273 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88c81aef-11a4-48b1-afb2-8edbdb2242ef tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:09.817725 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88c81aef-11a4-48b1-afb2-8edbdb2242ef tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:09.818162 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88c81aef-11a4-48b1-afb2-8edbdb2242ef tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:09.844815 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6788435b-e69d-4886-961c-3171e0de49fc tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:09.853313 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6788435b-e69d-4886-961c-3171e0de49fc tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.168047 Aug 31 11:44:09.868212 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 105/211] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:09 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:09.963237 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-88c81aef-11a4-48b1-afb2-8edbdb2242ef tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:09.971414 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-88c81aef-11a4-48b1-afb2-8edbdb2242ef tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.168259 Aug 31 11:44:09.972417 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 107/212] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:09 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:10.372697 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-50971b20-1984-4a0b-b0e2-ddcad3e03e09 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:10.373297 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-50971b20-1984-4a0b-b0e2-ddcad3e03e09 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:10.379194 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-50971b20-1984-4a0b-b0e2-ddcad3e03e09 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:10.379674 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-50971b20-1984-4a0b-b0e2-ddcad3e03e09 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:10.380091 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-50971b20-1984-4a0b-b0e2-ddcad3e03e09 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:10.380780 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-50971b20-1984-4a0b-b0e2-ddcad3e03e09 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:10.381218 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-50971b20-1984-4a0b-b0e2-ddcad3e03e09 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:10.381632 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-50971b20-1984-4a0b-b0e2-ddcad3e03e09 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:10.481933 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c5f3b148-d999-4c31-be6a-f8a56a7a508e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:10.482626 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c5f3b148-d999-4c31-be6a-f8a56a7a508e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:10.488907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5f3b148-d999-4c31-be6a-f8a56a7a508e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:10.489391 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5f3b148-d999-4c31-be6a-f8a56a7a508e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:10.489876 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5f3b148-d999-4c31-be6a-f8a56a7a508e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:10.490568 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5f3b148-d999-4c31-be6a-f8a56a7a508e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:10.491012 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5f3b148-d999-4c31-be6a-f8a56a7a508e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:10.491424 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5f3b148-d999-4c31-be6a-f8a56a7a508e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:10.525059 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-50971b20-1984-4a0b-b0e2-ddcad3e03e09 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:10.533243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-50971b20-1984-4a0b-b0e2-ddcad3e03e09 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:10.535287 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-50971b20-1984-4a0b-b0e2-ddcad3e03e09 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:10.536355 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-50971b20-1984-4a0b-b0e2-ddcad3e03e09 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.167568 Aug 31 11:44:10.540020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 106/213] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:10 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:10.550447 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6542b4d8-7bf8-450c-8b42-3681a3254453 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:10.551045 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6542b4d8-7bf8-450c-8b42-3681a3254453 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:10.557917 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6542b4d8-7bf8-450c-8b42-3681a3254453 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:10.558398 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6542b4d8-7bf8-450c-8b42-3681a3254453 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:10.558824 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6542b4d8-7bf8-450c-8b42-3681a3254453 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:10.559515 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6542b4d8-7bf8-450c-8b42-3681a3254453 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:10.560438 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6542b4d8-7bf8-450c-8b42-3681a3254453 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:10.560895 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6542b4d8-7bf8-450c-8b42-3681a3254453 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:10.669225 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c5f3b148-d999-4c31-be6a-f8a56a7a508e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:10.677458 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c5f3b148-d999-4c31-be6a-f8a56a7a508e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.199594 Aug 31 11:44:10.678036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 108/214] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:10 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:10.717102 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6542b4d8-7bf8-450c-8b42-3681a3254453 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:10.725504 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6542b4d8-7bf8-450c-8b42-3681a3254453 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.178795 Aug 31 11:44:10.726090 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 107/215] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:10 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:10.875397 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-452a2b80-05ac-4d82-bf80-aa5cb2caefd7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:10.876032 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-452a2b80-05ac-4d82-bf80-aa5cb2caefd7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:10.883231 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-452a2b80-05ac-4d82-bf80-aa5cb2caefd7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:10.883649 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-452a2b80-05ac-4d82-bf80-aa5cb2caefd7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:10.884082 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-452a2b80-05ac-4d82-bf80-aa5cb2caefd7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:10.884793 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-452a2b80-05ac-4d82-bf80-aa5cb2caefd7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:10.885243 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-452a2b80-05ac-4d82-bf80-aa5cb2caefd7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:10.885662 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-452a2b80-05ac-4d82-bf80-aa5cb2caefd7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:10.991423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d52c0b3b-d106-425a-acf7-c979a4ff924b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:10.992029 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d52c0b3b-d106-425a-acf7-c979a4ff924b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:10.998035 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d52c0b3b-d106-425a-acf7-c979a4ff924b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:10.998520 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d52c0b3b-d106-425a-acf7-c979a4ff924b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:10.998949 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d52c0b3b-d106-425a-acf7-c979a4ff924b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:10.999633 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d52c0b3b-d106-425a-acf7-c979a4ff924b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:11.000080 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d52c0b3b-d106-425a-acf7-c979a4ff924b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:11.000521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d52c0b3b-d106-425a-acf7-c979a4ff924b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:11.015277 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-452a2b80-05ac-4d82-bf80-aa5cb2caefd7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:11.023674 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-452a2b80-05ac-4d82-bf80-aa5cb2caefd7 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.152137 Aug 31 11:44:11.024248 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 109/216] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:10 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:11.132676 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d52c0b3b-d106-425a-acf7-c979a4ff924b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:11.140254 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d52c0b3b-d106-425a-acf7-c979a4ff924b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.152681 Aug 31 11:44:11.140788 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 108/217] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:10 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:11.558688 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b1d2a81b-aa57-49d9-b798-e07d83efb72b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:11.559221 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b1d2a81b-aa57-49d9-b798-e07d83efb72b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:11.566081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b1d2a81b-aa57-49d9-b798-e07d83efb72b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:11.566565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b1d2a81b-aa57-49d9-b798-e07d83efb72b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:11.567001 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b1d2a81b-aa57-49d9-b798-e07d83efb72b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:11.567684 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b1d2a81b-aa57-49d9-b798-e07d83efb72b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:11.568131 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b1d2a81b-aa57-49d9-b798-e07d83efb72b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:11.568586 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b1d2a81b-aa57-49d9-b798-e07d83efb72b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:11.698005 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-add66419-f53d-4b06-980f-516a5a66258c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:11.698615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-add66419-f53d-4b06-980f-516a5a66258c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:11.698734 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b1d2a81b-aa57-49d9-b798-e07d83efb72b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:11.704548 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-add66419-f53d-4b06-980f-516a5a66258c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:11.705033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-add66419-f53d-4b06-980f-516a5a66258c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:11.705539 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-add66419-f53d-4b06-980f-516a5a66258c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:11.707000 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-add66419-f53d-4b06-980f-516a5a66258c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:11.707377 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-add66419-f53d-4b06-980f-516a5a66258c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:11.707800 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-add66419-f53d-4b06-980f-516a5a66258c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:11.708290 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b1d2a81b-aa57-49d9-b798-e07d83efb72b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:11.709801 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b1d2a81b-aa57-49d9-b798-e07d83efb72b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:11.711006 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b1d2a81b-aa57-49d9-b798-e07d83efb72b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.156332 Aug 31 11:44:11.711801 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 110/218] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:11 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:11.745837 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e0315fe9-b3cf-483a-9df7-de4a9c29b4b7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:11.746534 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e0315fe9-b3cf-483a-9df7-de4a9c29b4b7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:11.753620 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e0315fe9-b3cf-483a-9df7-de4a9c29b4b7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:11.754409 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e0315fe9-b3cf-483a-9df7-de4a9c29b4b7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:11.754908 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e0315fe9-b3cf-483a-9df7-de4a9c29b4b7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:11.755666 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e0315fe9-b3cf-483a-9df7-de4a9c29b4b7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:11.756183 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e0315fe9-b3cf-483a-9df7-de4a9c29b4b7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:11.756728 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e0315fe9-b3cf-483a-9df7-de4a9c29b4b7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:11.838452 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-add66419-f53d-4b06-980f-516a5a66258c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:11.846130 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-add66419-f53d-4b06-980f-516a5a66258c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.151953 Aug 31 11:44:11.846694 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 109/219] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:11 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:11.889396 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e0315fe9-b3cf-483a-9df7-de4a9c29b4b7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:11.898019 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e0315fe9-b3cf-483a-9df7-de4a9c29b4b7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.156029 Aug 31 11:44:11.898589 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 111/220] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:11 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:12.044234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d446cb9b-992d-4411-ad54-85a96ed71903 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:12.044868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d446cb9b-992d-4411-ad54-85a96ed71903 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:12.051361 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d446cb9b-992d-4411-ad54-85a96ed71903 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:12.051838 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d446cb9b-992d-4411-ad54-85a96ed71903 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:12.052269 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d446cb9b-992d-4411-ad54-85a96ed71903 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:12.053002 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d446cb9b-992d-4411-ad54-85a96ed71903 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:12.053449 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d446cb9b-992d-4411-ad54-85a96ed71903 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:12.053872 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d446cb9b-992d-4411-ad54-85a96ed71903 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:12.161293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-16dc1294-a6fa-4522-abfb-48881a0592ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:12.161903 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-16dc1294-a6fa-4522-abfb-48881a0592ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:12.167681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-16dc1294-a6fa-4522-abfb-48881a0592ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:12.168162 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-16dc1294-a6fa-4522-abfb-48881a0592ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:12.168626 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-16dc1294-a6fa-4522-abfb-48881a0592ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:12.169314 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-16dc1294-a6fa-4522-abfb-48881a0592ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:12.169767 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-16dc1294-a6fa-4522-abfb-48881a0592ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:12.170183 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-16dc1294-a6fa-4522-abfb-48881a0592ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:12.178953 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d446cb9b-992d-4411-ad54-85a96ed71903 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:12.186581 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d446cb9b-992d-4411-ad54-85a96ed71903 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.146185 Aug 31 11:44:12.187151 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 110/221] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:12 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:12.301287 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-16dc1294-a6fa-4522-abfb-48881a0592ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:12.308860 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-16dc1294-a6fa-4522-abfb-48881a0592ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.151474 Aug 31 11:44:12.309426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 112/222] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:12 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:12.734609 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0ceb88dc-d125-4087-9b82-3c186af2099c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:12.735314 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-0ceb88dc-d125-4087-9b82-3c186af2099c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:12.742554 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0ceb88dc-d125-4087-9b82-3c186af2099c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:12.743040 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0ceb88dc-d125-4087-9b82-3c186af2099c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:12.743464 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0ceb88dc-d125-4087-9b82-3c186af2099c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:12.744162 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0ceb88dc-d125-4087-9b82-3c186af2099c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:12.744648 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0ceb88dc-d125-4087-9b82-3c186af2099c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:12.745073 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0ceb88dc-d125-4087-9b82-3c186af2099c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:12.866876 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a2eee86c-c456-4a58-9c4a-57dcaa020d27 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:12.867555 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a2eee86c-c456-4a58-9c4a-57dcaa020d27 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:12.873558 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a2eee86c-c456-4a58-9c4a-57dcaa020d27 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:12.874039 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a2eee86c-c456-4a58-9c4a-57dcaa020d27 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:12.874476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a2eee86c-c456-4a58-9c4a-57dcaa020d27 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:12.875164 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a2eee86c-c456-4a58-9c4a-57dcaa020d27 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:12.875620 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a2eee86c-c456-4a58-9c4a-57dcaa020d27 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:12.876043 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a2eee86c-c456-4a58-9c4a-57dcaa020d27 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:12.876156 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0ceb88dc-d125-4087-9b82-3c186af2099c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:12.884806 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0ceb88dc-d125-4087-9b82-3c186af2099c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:12.886266 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0ceb88dc-d125-4087-9b82-3c186af2099c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:12.887349 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0ceb88dc-d125-4087-9b82-3c186af2099c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.156588 Aug 31 11:44:12.887908 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 111/223] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:12 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:12.919040 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-97fa8754-9f4f-4194-a5d3-a9dca2a7fb1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:12.919635 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-97fa8754-9f4f-4194-a5d3-a9dca2a7fb1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:12.925668 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-97fa8754-9f4f-4194-a5d3-a9dca2a7fb1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:12.926145 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-97fa8754-9f4f-4194-a5d3-a9dca2a7fb1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:12.926595 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-97fa8754-9f4f-4194-a5d3-a9dca2a7fb1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:12.927277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-97fa8754-9f4f-4194-a5d3-a9dca2a7fb1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:12.927720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-97fa8754-9f4f-4194-a5d3-a9dca2a7fb1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:12.928135 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-97fa8754-9f4f-4194-a5d3-a9dca2a7fb1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:13.011756 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a2eee86c-c456-4a58-9c4a-57dcaa020d27 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:13.015139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:13.020517 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a2eee86c-c456-4a58-9c4a-57dcaa020d27 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.157494 Aug 31 11:44:13.021123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 113/224] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:12 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:13.061610 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-97fa8754-9f4f-4194-a5d3-a9dca2a7fb1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:13.070016 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-97fa8754-9f4f-4194-a5d3-a9dca2a7fb1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.154830 Aug 31 11:44:13.070566 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 112/225] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:12 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:13.208348 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-bb2bd6f1-20bb-46b0-989c-33c940b3cb01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:13.208931 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-bb2bd6f1-20bb-46b0-989c-33c940b3cb01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:13.215378 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bb2bd6f1-20bb-46b0-989c-33c940b3cb01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:13.215860 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bb2bd6f1-20bb-46b0-989c-33c940b3cb01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:13.216292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bb2bd6f1-20bb-46b0-989c-33c940b3cb01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:13.216998 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bb2bd6f1-20bb-46b0-989c-33c940b3cb01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:13.217448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bb2bd6f1-20bb-46b0-989c-33c940b3cb01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:13.217871 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bb2bd6f1-20bb-46b0-989c-33c940b3cb01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:13.331121 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-67886034-0524-436c-8d25-22ae3a273b89 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:13.331716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-67886034-0524-436c-8d25-22ae3a273b89 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:13.337476 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-67886034-0524-436c-8d25-22ae3a273b89 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:13.337945 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-67886034-0524-436c-8d25-22ae3a273b89 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:13.338371 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-67886034-0524-436c-8d25-22ae3a273b89 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:13.339044 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-67886034-0524-436c-8d25-22ae3a273b89 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:13.339485 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-67886034-0524-436c-8d25-22ae3a273b89 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:13.339898 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-67886034-0524-436c-8d25-22ae3a273b89 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:13.349620 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-bb2bd6f1-20bb-46b0-989c-33c940b3cb01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:13.357319 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-bb2bd6f1-20bb-46b0-989c-33c940b3cb01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.153254 Aug 31 11:44:13.358105 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 114/226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:13 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:13.469363 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-67886034-0524-436c-8d25-22ae3a273b89 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:13.477458 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-67886034-0524-436c-8d25-22ae3a273b89 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.150264 Aug 31 11:44:13.478018 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 113/227] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:13 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:13.911094 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-43536c71-53a7-40a6-8f3d-d611dff07689 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:13.911720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-43536c71-53a7-40a6-8f3d-d611dff07689 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:13.917623 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43536c71-53a7-40a6-8f3d-d611dff07689 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:13.918102 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43536c71-53a7-40a6-8f3d-d611dff07689 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:13.918535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43536c71-53a7-40a6-8f3d-d611dff07689 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:13.919238 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43536c71-53a7-40a6-8f3d-d611dff07689 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:13.919685 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43536c71-53a7-40a6-8f3d-d611dff07689 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:13.920120 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43536c71-53a7-40a6-8f3d-d611dff07689 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:14.041204 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-732b5861-37f4-431e-9d79-a091de8b1c56 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:14.041866 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-732b5861-37f4-431e-9d79-a091de8b1c56 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:14.047965 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-732b5861-37f4-431e-9d79-a091de8b1c56 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:14.048361 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-43536c71-53a7-40a6-8f3d-d611dff07689 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:14.048481 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-732b5861-37f4-431e-9d79-a091de8b1c56 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:14.048903 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-732b5861-37f4-431e-9d79-a091de8b1c56 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:14.049799 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-732b5861-37f4-431e-9d79-a091de8b1c56 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:14.050362 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-732b5861-37f4-431e-9d79-a091de8b1c56 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:14.050789 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-732b5861-37f4-431e-9d79-a091de8b1c56 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:14.056322 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-43536c71-53a7-40a6-8f3d-d611dff07689 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:14.057778 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-43536c71-53a7-40a6-8f3d-d611dff07689 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:14.058870 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-43536c71-53a7-40a6-8f3d-d611dff07689 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.152675 Aug 31 11:44:14.059425 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 115/228] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:13 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:14.091135 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-87bcc7ce-ad41-4a0d-b6fa-ffeadaff85af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:14.094033 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-87bcc7ce-ad41-4a0d-b6fa-ffeadaff85af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:14.100863 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87bcc7ce-ad41-4a0d-b6fa-ffeadaff85af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:14.101343 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87bcc7ce-ad41-4a0d-b6fa-ffeadaff85af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:14.101878 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87bcc7ce-ad41-4a0d-b6fa-ffeadaff85af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:14.102562 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87bcc7ce-ad41-4a0d-b6fa-ffeadaff85af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:14.103006 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87bcc7ce-ad41-4a0d-b6fa-ffeadaff85af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:14.103415 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87bcc7ce-ad41-4a0d-b6fa-ffeadaff85af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:14.180802 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-732b5861-37f4-431e-9d79-a091de8b1c56 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:14.188325 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-732b5861-37f4-431e-9d79-a091de8b1c56 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.151081 Aug 31 11:44:14.188993 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 114/229] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:14 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:14.234204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-87bcc7ce-ad41-4a0d-b6fa-ffeadaff85af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:14.242105 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-87bcc7ce-ad41-4a0d-b6fa-ffeadaff85af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.155347 Aug 31 11:44:14.242669 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 116/230] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:14 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:14.378619 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f108d940-1c54-471c-bf93-1d624c10ba7b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:14.379223 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f108d940-1c54-471c-bf93-1d624c10ba7b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:14.386579 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f108d940-1c54-471c-bf93-1d624c10ba7b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:14.387444 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f108d940-1c54-471c-bf93-1d624c10ba7b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:14.388257 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f108d940-1c54-471c-bf93-1d624c10ba7b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:14.389500 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f108d940-1c54-471c-bf93-1d624c10ba7b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:14.389965 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f108d940-1c54-471c-bf93-1d624c10ba7b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:14.390394 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f108d940-1c54-471c-bf93-1d624c10ba7b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:14.395140 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:14.500813 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c95f45b8-cf3c-4490-969a-ef88e03d6dc5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:14.501421 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c95f45b8-cf3c-4490-969a-ef88e03d6dc5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:14.510806 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c95f45b8-cf3c-4490-969a-ef88e03d6dc5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:14.510806 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c95f45b8-cf3c-4490-969a-ef88e03d6dc5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:14.511087 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c95f45b8-cf3c-4490-969a-ef88e03d6dc5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:14.511658 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c95f45b8-cf3c-4490-969a-ef88e03d6dc5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:14.512114 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c95f45b8-cf3c-4490-969a-ef88e03d6dc5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:14.512564 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c95f45b8-cf3c-4490-969a-ef88e03d6dc5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:14.521512 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f108d940-1c54-471c-bf93-1d624c10ba7b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:14.528954 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f108d940-1c54-471c-bf93-1d624c10ba7b tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.154394 Aug 31 11:44:14.529916 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 115/231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:14 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:14.641425 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c95f45b8-cf3c-4490-969a-ef88e03d6dc5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:14.648840 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c95f45b8-cf3c-4490-969a-ef88e03d6dc5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.152051 Aug 31 11:44:14.649397 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 117/232] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:14 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:15.082105 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-30ebe205-dff3-45b2-8376-60292f8fa239 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:15.082705 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-30ebe205-dff3-45b2-8376-60292f8fa239 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:15.089533 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-30ebe205-dff3-45b2-8376-60292f8fa239 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:15.090020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-30ebe205-dff3-45b2-8376-60292f8fa239 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:15.090597 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-30ebe205-dff3-45b2-8376-60292f8fa239 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:15.091141 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-30ebe205-dff3-45b2-8376-60292f8fa239 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:15.091589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-30ebe205-dff3-45b2-8376-60292f8fa239 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:15.092007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-30ebe205-dff3-45b2-8376-60292f8fa239 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:15.209745 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f7f592e3-6d03-4485-8a47-8234aede8d53 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:15.211026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f7f592e3-6d03-4485-8a47-8234aede8d53 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:15.217403 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f7f592e3-6d03-4485-8a47-8234aede8d53 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:15.218207 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f7f592e3-6d03-4485-8a47-8234aede8d53 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:15.218713 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f7f592e3-6d03-4485-8a47-8234aede8d53 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:15.219485 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f7f592e3-6d03-4485-8a47-8234aede8d53 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:15.220013 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f7f592e3-6d03-4485-8a47-8234aede8d53 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:15.220522 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f7f592e3-6d03-4485-8a47-8234aede8d53 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:15.267598 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-30ebe205-dff3-45b2-8376-60292f8fa239 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:15.277188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-30ebe205-dff3-45b2-8376-60292f8fa239 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:15.278912 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-30ebe205-dff3-45b2-8376-60292f8fa239 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:15.280041 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-30ebe205-dff3-45b2-8376-60292f8fa239 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.202553 Aug 31 11:44:15.289177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 116/233] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:15 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:44:15.298609 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6bbad117-5bd9-49cf-9d65-a79e631d33a6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:15.299622 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6bbad117-5bd9-49cf-9d65-a79e631d33a6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:15.307617 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6bbad117-5bd9-49cf-9d65-a79e631d33a6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:15.308291 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6bbad117-5bd9-49cf-9d65-a79e631d33a6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:15.308919 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6bbad117-5bd9-49cf-9d65-a79e631d33a6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:15.309900 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6bbad117-5bd9-49cf-9d65-a79e631d33a6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:15.310575 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6bbad117-5bd9-49cf-9d65-a79e631d33a6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:15.311724 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6bbad117-5bd9-49cf-9d65-a79e631d33a6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:15.383004 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f7f592e3-6d03-4485-8a47-8234aede8d53 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:15.391428 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f7f592e3-6d03-4485-8a47-8234aede8d53 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.186477 Aug 31 11:44:15.405689 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 118/234] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:15 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:15.414521 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-87b33634-768d-40ef-8175-3c93c4eb34f0 req-626a1def-bdd8-4bf4-aaa2-00e8520f876a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece59cd5-8579-4406-be68-9d0204aeb446", "name": "network-vif-plugged", "status": "completed", "tag": "df889158-674c-400a-bd63-cbcff640456f"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:44:15.424006 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-87b33634-768d-40ef-8175-3c93c4eb34f0 req-626a1def-bdd8-4bf4-aaa2-00e8520f876a service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:15.425193 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-87b33634-768d-40ef-8175-3c93c4eb34f0 req-626a1def-bdd8-4bf4-aaa2-00e8520f876a service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:15.425638 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-87b33634-768d-40ef-8175-3c93c4eb34f0 req-626a1def-bdd8-4bf4-aaa2-00e8520f876a service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:15.437088 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-87b33634-768d-40ef-8175-3c93c4eb34f0 req-626a1def-bdd8-4bf4-aaa2-00e8520f876a service nova] Creating event network-vif-plugged:df889158-674c-400a-bd63-cbcff640456f for instance ece59cd5-8579-4406-be68-9d0204aeb446 on hv-cinder-83976 Aug 31 11:44:15.444463 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-87b33634-768d-40ef-8175-3c93c4eb34f0 req-626a1def-bdd8-4bf4-aaa2-00e8520f876a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037234 Aug 31 11:44:15.445194 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 119/235] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:44:15.467695 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6bbad117-5bd9-49cf-9d65-a79e631d33a6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:15.486906 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6bbad117-5bd9-49cf-9d65-a79e631d33a6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.185937 Aug 31 11:44:15.487913 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 117/236] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:15 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:15.550916 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ac2ed912-7b7d-4c7e-a426-8609b6ce2816 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:15.551696 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ac2ed912-7b7d-4c7e-a426-8609b6ce2816 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:15.557927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ac2ed912-7b7d-4c7e-a426-8609b6ce2816 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:15.558415 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ac2ed912-7b7d-4c7e-a426-8609b6ce2816 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:15.558846 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ac2ed912-7b7d-4c7e-a426-8609b6ce2816 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:15.559533 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ac2ed912-7b7d-4c7e-a426-8609b6ce2816 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:15.559983 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ac2ed912-7b7d-4c7e-a426-8609b6ce2816 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:15.560406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ac2ed912-7b7d-4c7e-a426-8609b6ce2816 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:15.669725 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-80f2db4f-e0a0-4ddb-affc-00b3692f20b3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:15.670325 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-80f2db4f-e0a0-4ddb-affc-00b3692f20b3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:15.685683 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-80f2db4f-e0a0-4ddb-affc-00b3692f20b3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:15.686186 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-80f2db4f-e0a0-4ddb-affc-00b3692f20b3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:15.686622 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-80f2db4f-e0a0-4ddb-affc-00b3692f20b3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:15.687333 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-80f2db4f-e0a0-4ddb-affc-00b3692f20b3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:15.687784 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-80f2db4f-e0a0-4ddb-affc-00b3692f20b3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:15.688208 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-80f2db4f-e0a0-4ddb-affc-00b3692f20b3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:15.701712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ac2ed912-7b7d-4c7e-a426-8609b6ce2816 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:15.710046 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ac2ed912-7b7d-4c7e-a426-8609b6ce2816 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.163623 Aug 31 11:44:15.710830 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 120/237] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:15 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:15.832629 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-80f2db4f-e0a0-4ddb-affc-00b3692f20b3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:15.841349 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-80f2db4f-e0a0-4ddb-affc-00b3692f20b3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.174996 Aug 31 11:44:15.841457 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 118/238] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:15 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:16.303252 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c32014ad-f3e1-427f-97dc-c14938d247fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:16.303860 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c32014ad-f3e1-427f-97dc-c14938d247fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:16.306894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:16.310900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c32014ad-f3e1-427f-97dc-c14938d247fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:16.311382 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c32014ad-f3e1-427f-97dc-c14938d247fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:16.311807 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c32014ad-f3e1-427f-97dc-c14938d247fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:16.312515 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c32014ad-f3e1-427f-97dc-c14938d247fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:16.312952 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c32014ad-f3e1-427f-97dc-c14938d247fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:16.313368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c32014ad-f3e1-427f-97dc-c14938d247fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:16.418569 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c306f7d0-6bef-453b-9c29-eff91caacfaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:16.419228 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c306f7d0-6bef-453b-9c29-eff91caacfaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:16.426099 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c306f7d0-6bef-453b-9c29-eff91caacfaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:16.426769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c306f7d0-6bef-453b-9c29-eff91caacfaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:16.427525 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c306f7d0-6bef-453b-9c29-eff91caacfaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:16.428798 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c306f7d0-6bef-453b-9c29-eff91caacfaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:16.429597 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c306f7d0-6bef-453b-9c29-eff91caacfaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:16.430376 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c306f7d0-6bef-453b-9c29-eff91caacfaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:16.443198 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c32014ad-f3e1-427f-97dc-c14938d247fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:16.451391 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c32014ad-f3e1-427f-97dc-c14938d247fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:16.452931 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c32014ad-f3e1-427f-97dc-c14938d247fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:16.454028 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c32014ad-f3e1-427f-97dc-c14938d247fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.155270 Aug 31 11:44:16.454667 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 121/239] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:16 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:44:16.507649 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9af1807d-4367-4f4c-a96a-e02da4c97184 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:16.508254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9af1807d-4367-4f4c-a96a-e02da4c97184 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:16.514125 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9af1807d-4367-4f4c-a96a-e02da4c97184 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:16.514613 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9af1807d-4367-4f4c-a96a-e02da4c97184 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:16.515049 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9af1807d-4367-4f4c-a96a-e02da4c97184 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:16.515735 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9af1807d-4367-4f4c-a96a-e02da4c97184 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:16.516181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9af1807d-4367-4f4c-a96a-e02da4c97184 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:16.516631 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9af1807d-4367-4f4c-a96a-e02da4c97184 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:16.567181 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c306f7d0-6bef-453b-9c29-eff91caacfaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:16.574929 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c306f7d0-6bef-453b-9c29-eff91caacfaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.160134 Aug 31 11:44:16.575496 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 119/240] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:16 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:16.667017 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9af1807d-4367-4f4c-a96a-e02da4c97184 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:16.675138 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9af1807d-4367-4f4c-a96a-e02da4c97184 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.171188 Aug 31 11:44:16.675889 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 122/241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:16 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:16.730866 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a5dd560c-1b5c-419c-a38a-7277792e0e01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:16.731559 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a5dd560c-1b5c-419c-a38a-7277792e0e01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:16.738087 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a5dd560c-1b5c-419c-a38a-7277792e0e01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:16.738573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a5dd560c-1b5c-419c-a38a-7277792e0e01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:16.739004 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a5dd560c-1b5c-419c-a38a-7277792e0e01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:16.739694 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a5dd560c-1b5c-419c-a38a-7277792e0e01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:16.740217 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a5dd560c-1b5c-419c-a38a-7277792e0e01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:16.740688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a5dd560c-1b5c-419c-a38a-7277792e0e01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:16.861660 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1bbe1d73-3e7c-47a7-92b2-dde8c9632fce tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:16.862227 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1bbe1d73-3e7c-47a7-92b2-dde8c9632fce tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:16.868122 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1bbe1d73-3e7c-47a7-92b2-dde8c9632fce tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:16.868640 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1bbe1d73-3e7c-47a7-92b2-dde8c9632fce tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:16.869066 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1bbe1d73-3e7c-47a7-92b2-dde8c9632fce tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:16.869741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1bbe1d73-3e7c-47a7-92b2-dde8c9632fce tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:16.870180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1bbe1d73-3e7c-47a7-92b2-dde8c9632fce tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:16.870593 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1bbe1d73-3e7c-47a7-92b2-dde8c9632fce tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:16.875551 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a5dd560c-1b5c-419c-a38a-7277792e0e01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:16.884077 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a5dd560c-1b5c-419c-a38a-7277792e0e01 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.157298 Aug 31 11:44:16.884677 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 120/242] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:16 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:16.998937 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1bbe1d73-3e7c-47a7-92b2-dde8c9632fce tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:17.007294 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1bbe1d73-3e7c-47a7-92b2-dde8c9632fce tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.149535 Aug 31 11:44:17.007864 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 123/243] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:16 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:17.477805 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-433ab7d0-1826-4df0-86af-c998f5fd936e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:17.478452 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-433ab7d0-1826-4df0-86af-c998f5fd936e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:17.484579 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-433ab7d0-1826-4df0-86af-c998f5fd936e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:17.485022 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-433ab7d0-1826-4df0-86af-c998f5fd936e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:17.485473 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-433ab7d0-1826-4df0-86af-c998f5fd936e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:17.486140 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-433ab7d0-1826-4df0-86af-c998f5fd936e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:17.487636 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-433ab7d0-1826-4df0-86af-c998f5fd936e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:17.487636 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-433ab7d0-1826-4df0-86af-c998f5fd936e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:17.602155 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5bf9a21b-c46b-4dd5-8b08-8709ee92bc05 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:17.606970 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5bf9a21b-c46b-4dd5-8b08-8709ee92bc05 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:17.620351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5bf9a21b-c46b-4dd5-8b08-8709ee92bc05 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:17.620898 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5bf9a21b-c46b-4dd5-8b08-8709ee92bc05 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:17.621337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5bf9a21b-c46b-4dd5-8b08-8709ee92bc05 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:17.622255 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5bf9a21b-c46b-4dd5-8b08-8709ee92bc05 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:17.622713 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5bf9a21b-c46b-4dd5-8b08-8709ee92bc05 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:17.623333 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5bf9a21b-c46b-4dd5-8b08-8709ee92bc05 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:17.668567 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-433ab7d0-1826-4df0-86af-c998f5fd936e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:17.678001 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-433ab7d0-1826-4df0-86af-c998f5fd936e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:17.679491 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-433ab7d0-1826-4df0-86af-c998f5fd936e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:17.680817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-433ab7d0-1826-4df0-86af-c998f5fd936e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.206719 Aug 31 11:44:17.688369 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 121/244] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:17 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:44:17.695734 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8be02a3d-4c7f-4f1f-b64f-e59e65774237 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:17.696370 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8be02a3d-4c7f-4f1f-b64f-e59e65774237 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:17.703375 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8be02a3d-4c7f-4f1f-b64f-e59e65774237 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:17.703859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8be02a3d-4c7f-4f1f-b64f-e59e65774237 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:17.704288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8be02a3d-4c7f-4f1f-b64f-e59e65774237 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:17.705070 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8be02a3d-4c7f-4f1f-b64f-e59e65774237 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:17.706197 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8be02a3d-4c7f-4f1f-b64f-e59e65774237 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:17.706853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8be02a3d-4c7f-4f1f-b64f-e59e65774237 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:17.773296 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5bf9a21b-c46b-4dd5-8b08-8709ee92bc05 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:17.783899 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5bf9a21b-c46b-4dd5-8b08-8709ee92bc05 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.189896 Aug 31 11:44:17.784465 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 124/245] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:17 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:17.853480 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8be02a3d-4c7f-4f1f-b64f-e59e65774237 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:17.861061 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8be02a3d-4c7f-4f1f-b64f-e59e65774237 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.168986 Aug 31 11:44:17.861664 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 122/246] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:17 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:17.906381 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-eada690d-4a6d-4c51-9d89-02c5fa2efada tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:17.906981 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-eada690d-4a6d-4c51-9d89-02c5fa2efada tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:17.918118 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eada690d-4a6d-4c51-9d89-02c5fa2efada tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:17.918621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eada690d-4a6d-4c51-9d89-02c5fa2efada tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:17.919673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eada690d-4a6d-4c51-9d89-02c5fa2efada tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:17.920387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eada690d-4a6d-4c51-9d89-02c5fa2efada tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:17.921040 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eada690d-4a6d-4c51-9d89-02c5fa2efada tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:17.921475 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eada690d-4a6d-4c51-9d89-02c5fa2efada tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:18.028039 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-25c477e0-2d69-4cf1-98b3-f6b9d8462892 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:18.028686 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-25c477e0-2d69-4cf1-98b3-f6b9d8462892 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:18.034611 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-25c477e0-2d69-4cf1-98b3-f6b9d8462892 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:18.035092 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-25c477e0-2d69-4cf1-98b3-f6b9d8462892 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:18.035693 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-25c477e0-2d69-4cf1-98b3-f6b9d8462892 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:18.036279 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-25c477e0-2d69-4cf1-98b3-f6b9d8462892 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:18.036830 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-25c477e0-2d69-4cf1-98b3-f6b9d8462892 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:18.037277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-25c477e0-2d69-4cf1-98b3-f6b9d8462892 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:18.057976 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-eada690d-4a6d-4c51-9d89-02c5fa2efada tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:18.065718 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-eada690d-4a6d-4c51-9d89-02c5fa2efada tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.163511 Aug 31 11:44:18.066293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 125/247] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:17 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:18.178842 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-25c477e0-2d69-4cf1-98b3-f6b9d8462892 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:18.186665 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-25c477e0-2d69-4cf1-98b3-f6b9d8462892 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.162421 Aug 31 11:44:18.187373 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 123/248] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:18 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:18.705105 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-10cbad27-4179-4421-90ac-bb661a4aebf8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:18.706324 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-10cbad27-4179-4421-90ac-bb661a4aebf8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:18.712238 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-10cbad27-4179-4421-90ac-bb661a4aebf8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:18.712750 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-10cbad27-4179-4421-90ac-bb661a4aebf8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:18.713184 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-10cbad27-4179-4421-90ac-bb661a4aebf8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:18.713875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-10cbad27-4179-4421-90ac-bb661a4aebf8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:18.714324 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-10cbad27-4179-4421-90ac-bb661a4aebf8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:18.714747 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-10cbad27-4179-4421-90ac-bb661a4aebf8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:18.809174 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-499a35bd-d384-46e9-9007-78aa83e4197f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:18.810512 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-499a35bd-d384-46e9-9007-78aa83e4197f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:18.812711 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:18.817107 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:18.819632 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-499a35bd-d384-46e9-9007-78aa83e4197f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:18.820330 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-499a35bd-d384-46e9-9007-78aa83e4197f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:18.820794 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-499a35bd-d384-46e9-9007-78aa83e4197f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:18.821497 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-499a35bd-d384-46e9-9007-78aa83e4197f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:18.821975 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-499a35bd-d384-46e9-9007-78aa83e4197f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:18.822402 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-499a35bd-d384-46e9-9007-78aa83e4197f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:18.853866 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-10cbad27-4179-4421-90ac-bb661a4aebf8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:18.862707 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-10cbad27-4179-4421-90ac-bb661a4aebf8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:18.864608 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-10cbad27-4179-4421-90ac-bb661a4aebf8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:18.865971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-10cbad27-4179-4421-90ac-bb661a4aebf8 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.164696 Aug 31 11:44:18.881407 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 126/249] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:18 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:18.887300 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-31170b45-eec5-4302-adbc-ad16fc2bfec8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:18.887902 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-31170b45-eec5-4302-adbc-ad16fc2bfec8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:18.894311 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-31170b45-eec5-4302-adbc-ad16fc2bfec8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:18.894999 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-31170b45-eec5-4302-adbc-ad16fc2bfec8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:18.895573 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-31170b45-eec5-4302-adbc-ad16fc2bfec8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:18.896469 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-31170b45-eec5-4302-adbc-ad16fc2bfec8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:18.896933 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-31170b45-eec5-4302-adbc-ad16fc2bfec8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:18.897532 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-31170b45-eec5-4302-adbc-ad16fc2bfec8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:18.977971 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-499a35bd-d384-46e9-9007-78aa83e4197f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:18.985813 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-499a35bd-d384-46e9-9007-78aa83e4197f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.181238 Aug 31 11:44:18.986380 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 124/250] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:18 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:19.043399 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-31170b45-eec5-4302-adbc-ad16fc2bfec8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:19.051934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-31170b45-eec5-4302-adbc-ad16fc2bfec8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.169428 Aug 31 11:44:19.052509 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 127/251] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:18 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:19.088825 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-458a6352-c109-4ba1-b989-032ad7d625f8 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:19.089485 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-458a6352-c109-4ba1-b989-032ad7d625f8 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:19.095357 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-458a6352-c109-4ba1-b989-032ad7d625f8 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:19.095832 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-458a6352-c109-4ba1-b989-032ad7d625f8 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:19.096423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-458a6352-c109-4ba1-b989-032ad7d625f8 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:19.097132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-458a6352-c109-4ba1-b989-032ad7d625f8 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:19.097570 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-458a6352-c109-4ba1-b989-032ad7d625f8 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:19.098010 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-458a6352-c109-4ba1-b989-032ad7d625f8 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:19.207570 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-963b2633-3558-4cd1-a8ab-fe847c42289b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:19.208968 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-963b2633-3558-4cd1-a8ab-fe847c42289b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:19.216910 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-963b2633-3558-4cd1-a8ab-fe847c42289b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:19.217811 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-963b2633-3558-4cd1-a8ab-fe847c42289b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:19.218425 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-963b2633-3558-4cd1-a8ab-fe847c42289b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:19.219334 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-963b2633-3558-4cd1-a8ab-fe847c42289b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:19.219970 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-963b2633-3558-4cd1-a8ab-fe847c42289b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:19.220653 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-963b2633-3558-4cd1-a8ab-fe847c42289b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:19.254483 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-458a6352-c109-4ba1-b989-032ad7d625f8 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:19.262899 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-458a6352-c109-4ba1-b989-032ad7d625f8 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.177919 Aug 31 11:44:19.263473 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 125/252] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:19 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:19.388584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-963b2633-3558-4cd1-a8ab-fe847c42289b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:19.397903 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-963b2633-3558-4cd1-a8ab-fe847c42289b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.194526 Aug 31 11:44:19.398477 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 128/253] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:19 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:19.594049 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-2a21d126-bace-4ae1-99da-7c07c1c6010c req-c0891464-3a56-4fbc-8e4b-db7786c17d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a562f1ce-b46b-464a-9a4c-a9963f56dceb", "name": "network-vif-plugged", "status": "completed", "tag": "2c28681a-1560-4376-a0ce-7c613cf6890b"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:44:19.606743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-2a21d126-bace-4ae1-99da-7c07c1c6010c req-c0891464-3a56-4fbc-8e4b-db7786c17d91 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:19.607408 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-2a21d126-bace-4ae1-99da-7c07c1c6010c req-c0891464-3a56-4fbc-8e4b-db7786c17d91 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:19.608136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-2a21d126-bace-4ae1-99da-7c07c1c6010c req-c0891464-3a56-4fbc-8e4b-db7786c17d91 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:19.622877 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-2a21d126-bace-4ae1-99da-7c07c1c6010c req-c0891464-3a56-4fbc-8e4b-db7786c17d91 service nova] Creating event network-vif-plugged:2c28681a-1560-4376-a0ce-7c613cf6890b for instance a562f1ce-b46b-464a-9a4c-a9963f56dceb on hv-cinder-83976 Aug 31 11:44:19.628995 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-2a21d126-bace-4ae1-99da-7c07c1c6010c req-c0891464-3a56-4fbc-8e4b-db7786c17d91 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038305 Aug 31 11:44:19.630203 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 126/254] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:44:19.892380 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0c23e35e-6be7-43aa-80f7-f7bf16ea0710 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:19.894309 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0c23e35e-6be7-43aa-80f7-f7bf16ea0710 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:19.901433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c23e35e-6be7-43aa-80f7-f7bf16ea0710 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:19.902005 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c23e35e-6be7-43aa-80f7-f7bf16ea0710 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:19.902487 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c23e35e-6be7-43aa-80f7-f7bf16ea0710 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:19.903324 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c23e35e-6be7-43aa-80f7-f7bf16ea0710 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:19.914650 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c23e35e-6be7-43aa-80f7-f7bf16ea0710 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:19.915425 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c23e35e-6be7-43aa-80f7-f7bf16ea0710 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:20.008368 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7469e4cf-5b94-4106-af51-7076487ec9a4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:20.009234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7469e4cf-5b94-4106-af51-7076487ec9a4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:20.015551 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7469e4cf-5b94-4106-af51-7076487ec9a4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:20.016247 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7469e4cf-5b94-4106-af51-7076487ec9a4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:20.016880 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7469e4cf-5b94-4106-af51-7076487ec9a4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:20.017568 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7469e4cf-5b94-4106-af51-7076487ec9a4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:20.018434 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7469e4cf-5b94-4106-af51-7076487ec9a4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:20.019118 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7469e4cf-5b94-4106-af51-7076487ec9a4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:20.097321 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0c23e35e-6be7-43aa-80f7-f7bf16ea0710 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:20.118827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0c23e35e-6be7-43aa-80f7-f7bf16ea0710 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:20.120312 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0c23e35e-6be7-43aa-80f7-f7bf16ea0710 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:20.121494 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0c23e35e-6be7-43aa-80f7-f7bf16ea0710 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.232988 Aug 31 11:44:20.122063 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 129/255] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:19 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:20.129110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-eaa492f8-b5e1-4a48-a052-637b081b7cea tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:20.129898 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-eaa492f8-b5e1-4a48-a052-637b081b7cea tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:20.135929 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eaa492f8-b5e1-4a48-a052-637b081b7cea tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:20.136695 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eaa492f8-b5e1-4a48-a052-637b081b7cea tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:20.137319 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eaa492f8-b5e1-4a48-a052-637b081b7cea tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:20.138214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eaa492f8-b5e1-4a48-a052-637b081b7cea tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:20.138889 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eaa492f8-b5e1-4a48-a052-637b081b7cea tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:20.139666 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eaa492f8-b5e1-4a48-a052-637b081b7cea tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:20.194573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7469e4cf-5b94-4106-af51-7076487ec9a4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:20.202217 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7469e4cf-5b94-4106-af51-7076487ec9a4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.198206 Aug 31 11:44:20.203990 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 127/256] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:20 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:20.285515 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e1fb4ddb-0943-439f-81d9-590af03e68ce tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:20.286530 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e1fb4ddb-0943-439f-81d9-590af03e68ce tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:20.293836 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1fb4ddb-0943-439f-81d9-590af03e68ce tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:20.294875 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1fb4ddb-0943-439f-81d9-590af03e68ce tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:20.295725 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1fb4ddb-0943-439f-81d9-590af03e68ce tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:20.296843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1fb4ddb-0943-439f-81d9-590af03e68ce tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:20.297484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1fb4ddb-0943-439f-81d9-590af03e68ce tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:20.298096 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1fb4ddb-0943-439f-81d9-590af03e68ce tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:20.332621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-eaa492f8-b5e1-4a48-a052-637b081b7cea tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:20.347026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-eaa492f8-b5e1-4a48-a052-637b081b7cea tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.221038 Aug 31 11:44:20.347613 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 130/257] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:20 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:20.420320 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ac3a9821-47c0-4cc3-ae4d-7d17d49b1687 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:20.420952 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ac3a9821-47c0-4cc3-ae4d-7d17d49b1687 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:20.428038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ac3a9821-47c0-4cc3-ae4d-7d17d49b1687 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:20.428691 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ac3a9821-47c0-4cc3-ae4d-7d17d49b1687 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:20.429130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ac3a9821-47c0-4cc3-ae4d-7d17d49b1687 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:20.429825 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ac3a9821-47c0-4cc3-ae4d-7d17d49b1687 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:20.430272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ac3a9821-47c0-4cc3-ae4d-7d17d49b1687 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:20.430858 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ac3a9821-47c0-4cc3-ae4d-7d17d49b1687 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:20.435828 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:20.457904 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e1fb4ddb-0943-439f-81d9-590af03e68ce tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:20.465789 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e1fb4ddb-0943-439f-81d9-590af03e68ce tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.186462 Aug 31 11:44:20.469947 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 128/258] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:20 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:20.576895 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ac3a9821-47c0-4cc3-ae4d-7d17d49b1687 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:20.585517 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ac3a9821-47c0-4cc3-ae4d-7d17d49b1687 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.170321 Aug 31 11:44:20.586384 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 131/259] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:20 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:21.143362 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-91ac5201-5686-4a42-8165-fcdfdb928022 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:21.143973 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-91ac5201-5686-4a42-8165-fcdfdb928022 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:21.149818 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91ac5201-5686-4a42-8165-fcdfdb928022 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:21.150356 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91ac5201-5686-4a42-8165-fcdfdb928022 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:21.150763 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91ac5201-5686-4a42-8165-fcdfdb928022 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:21.151457 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91ac5201-5686-4a42-8165-fcdfdb928022 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:21.151903 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91ac5201-5686-4a42-8165-fcdfdb928022 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:21.152328 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91ac5201-5686-4a42-8165-fcdfdb928022 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:21.223742 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f3edca5c-24de-4558-9006-c5922eccc370 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:21.224797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f3edca5c-24de-4558-9006-c5922eccc370 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:21.231276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3edca5c-24de-4558-9006-c5922eccc370 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:21.231785 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3edca5c-24de-4558-9006-c5922eccc370 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:21.243564 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3edca5c-24de-4558-9006-c5922eccc370 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:21.244606 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3edca5c-24de-4558-9006-c5922eccc370 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:21.250200 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3edca5c-24de-4558-9006-c5922eccc370 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:21.250927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3edca5c-24de-4558-9006-c5922eccc370 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:21.298130 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-91ac5201-5686-4a42-8165-fcdfdb928022 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:21.322181 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-91ac5201-5686-4a42-8165-fcdfdb928022 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:21.324114 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-91ac5201-5686-4a42-8165-fcdfdb928022 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:21.325485 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-91ac5201-5686-4a42-8165-fcdfdb928022 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.186188 Aug 31 11:44:21.326042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 129/260] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:21 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:21.367666 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-01b19269-7772-4f5b-8018-a8b34261bcd7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:21.368529 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-01b19269-7772-4f5b-8018-a8b34261bcd7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:21.374529 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-01b19269-7772-4f5b-8018-a8b34261bcd7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:21.375016 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-01b19269-7772-4f5b-8018-a8b34261bcd7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:21.375450 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-01b19269-7772-4f5b-8018-a8b34261bcd7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:21.376146 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-01b19269-7772-4f5b-8018-a8b34261bcd7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:21.376625 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-01b19269-7772-4f5b-8018-a8b34261bcd7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:21.377071 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-01b19269-7772-4f5b-8018-a8b34261bcd7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:21.398737 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f3edca5c-24de-4558-9006-c5922eccc370 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:21.406395 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f3edca5c-24de-4558-9006-c5922eccc370 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.187014 Aug 31 11:44:21.407133 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 132/261] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:21 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:21.490755 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-686c2ad8-2c8c-4fbb-b504-1258da1c869d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:21.491413 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-686c2ad8-2c8c-4fbb-b504-1258da1c869d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:21.497272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-686c2ad8-2c8c-4fbb-b504-1258da1c869d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:21.497747 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-686c2ad8-2c8c-4fbb-b504-1258da1c869d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:21.498204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-686c2ad8-2c8c-4fbb-b504-1258da1c869d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:21.498877 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-686c2ad8-2c8c-4fbb-b504-1258da1c869d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:21.499319 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-686c2ad8-2c8c-4fbb-b504-1258da1c869d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:21.499729 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-686c2ad8-2c8c-4fbb-b504-1258da1c869d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:21.513732 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-01b19269-7772-4f5b-8018-a8b34261bcd7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:21.521589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-01b19269-7772-4f5b-8018-a8b34261bcd7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.157709 Aug 31 11:44:21.522160 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 130/262] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:21 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:21.606651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6e9be172-83f4-4e7d-b011-fd526986dfa7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:21.607249 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6e9be172-83f4-4e7d-b011-fd526986dfa7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:21.613819 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e9be172-83f4-4e7d-b011-fd526986dfa7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:21.614290 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e9be172-83f4-4e7d-b011-fd526986dfa7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:21.614709 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e9be172-83f4-4e7d-b011-fd526986dfa7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:21.615411 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e9be172-83f4-4e7d-b011-fd526986dfa7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:21.615846 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e9be172-83f4-4e7d-b011-fd526986dfa7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:21.616255 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e9be172-83f4-4e7d-b011-fd526986dfa7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:21.637174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-686c2ad8-2c8c-4fbb-b504-1258da1c869d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:21.644744 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-686c2ad8-2c8c-4fbb-b504-1258da1c869d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.158432 Aug 31 11:44:21.648558 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 133/263] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:21 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:21.742773 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6e9be172-83f4-4e7d-b011-fd526986dfa7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:21.750310 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6e9be172-83f4-4e7d-b011-fd526986dfa7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.147574 Aug 31 11:44:21.750875 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 131/264] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:21 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:22.347937 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6977292a-6478-44f4-b7ba-cc21cfc8cdba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:22.349200 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6977292a-6478-44f4-b7ba-cc21cfc8cdba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:22.355019 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6977292a-6478-44f4-b7ba-cc21cfc8cdba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:22.355499 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6977292a-6478-44f4-b7ba-cc21cfc8cdba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:22.355922 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6977292a-6478-44f4-b7ba-cc21cfc8cdba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:22.356629 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6977292a-6478-44f4-b7ba-cc21cfc8cdba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:22.357076 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6977292a-6478-44f4-b7ba-cc21cfc8cdba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:22.357490 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6977292a-6478-44f4-b7ba-cc21cfc8cdba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:22.430923 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6d1e4240-9f44-4b24-a9b9-f2321c5aa1bb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:22.431827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6d1e4240-9f44-4b24-a9b9-f2321c5aa1bb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:22.438348 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6d1e4240-9f44-4b24-a9b9-f2321c5aa1bb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:22.438900 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6d1e4240-9f44-4b24-a9b9-f2321c5aa1bb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:22.439399 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6d1e4240-9f44-4b24-a9b9-f2321c5aa1bb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:22.440884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6d1e4240-9f44-4b24-a9b9-f2321c5aa1bb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:22.441376 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6d1e4240-9f44-4b24-a9b9-f2321c5aa1bb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:22.443244 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6d1e4240-9f44-4b24-a9b9-f2321c5aa1bb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:22.462660 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:22.490562 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6977292a-6478-44f4-b7ba-cc21cfc8cdba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:22.498514 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6977292a-6478-44f4-b7ba-cc21cfc8cdba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:22.499951 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6977292a-6478-44f4-b7ba-cc21cfc8cdba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:22.501262 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6977292a-6478-44f4-b7ba-cc21cfc8cdba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.157857 Aug 31 11:44:22.501816 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 134/265] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:22 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:22.542664 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c76bfe5f-b871-4bb7-94bf-77c40b377df5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:22.543268 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c76bfe5f-b871-4bb7-94bf-77c40b377df5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:22.549811 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c76bfe5f-b871-4bb7-94bf-77c40b377df5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:22.550300 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c76bfe5f-b871-4bb7-94bf-77c40b377df5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:22.550729 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c76bfe5f-b871-4bb7-94bf-77c40b377df5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:22.551418 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c76bfe5f-b871-4bb7-94bf-77c40b377df5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:22.551870 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c76bfe5f-b871-4bb7-94bf-77c40b377df5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:22.552318 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c76bfe5f-b871-4bb7-94bf-77c40b377df5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:22.583921 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6d1e4240-9f44-4b24-a9b9-f2321c5aa1bb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:22.591637 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6d1e4240-9f44-4b24-a9b9-f2321c5aa1bb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.164495 Aug 31 11:44:22.592196 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 132/266] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:22 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:22.665425 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-312d9a9f-6e74-4f10-8a12-364f59bb3d85 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:22.666139 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-312d9a9f-6e74-4f10-8a12-364f59bb3d85 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:22.672033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-312d9a9f-6e74-4f10-8a12-364f59bb3d85 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:22.672658 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-312d9a9f-6e74-4f10-8a12-364f59bb3d85 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:22.673151 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-312d9a9f-6e74-4f10-8a12-364f59bb3d85 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:22.673959 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-312d9a9f-6e74-4f10-8a12-364f59bb3d85 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:22.674617 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-312d9a9f-6e74-4f10-8a12-364f59bb3d85 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:22.675488 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-312d9a9f-6e74-4f10-8a12-364f59bb3d85 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:22.686509 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c76bfe5f-b871-4bb7-94bf-77c40b377df5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:22.694770 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c76bfe5f-b871-4bb7-94bf-77c40b377df5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.155922 Aug 31 11:44:22.695335 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 135/267] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:22 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:22.771952 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e97f3925-20e9-4a04-bda9-99ca45a8572e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:22.772592 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e97f3925-20e9-4a04-bda9-99ca45a8572e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:22.778907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e97f3925-20e9-4a04-bda9-99ca45a8572e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:22.779406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e97f3925-20e9-4a04-bda9-99ca45a8572e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:22.779827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e97f3925-20e9-4a04-bda9-99ca45a8572e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:22.780535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e97f3925-20e9-4a04-bda9-99ca45a8572e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:22.780989 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e97f3925-20e9-4a04-bda9-99ca45a8572e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:22.781415 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e97f3925-20e9-4a04-bda9-99ca45a8572e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:22.804991 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-312d9a9f-6e74-4f10-8a12-364f59bb3d85 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:22.812853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-312d9a9f-6e74-4f10-8a12-364f59bb3d85 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.151145 Aug 31 11:44:22.813418 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 133/268] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:22 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:22.908141 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e97f3925-20e9-4a04-bda9-99ca45a8572e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:22.916164 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e97f3925-20e9-4a04-bda9-99ca45a8572e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.148987 Aug 31 11:44:22.916764 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 136/269] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:22 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:23.525270 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fc1ed5f8-6636-443c-a106-b63a3ed294b4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:23.525943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fc1ed5f8-6636-443c-a106-b63a3ed294b4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:23.532101 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fc1ed5f8-6636-443c-a106-b63a3ed294b4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:23.532674 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fc1ed5f8-6636-443c-a106-b63a3ed294b4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:23.533048 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fc1ed5f8-6636-443c-a106-b63a3ed294b4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:23.534367 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fc1ed5f8-6636-443c-a106-b63a3ed294b4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:23.534823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fc1ed5f8-6636-443c-a106-b63a3ed294b4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:23.535242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fc1ed5f8-6636-443c-a106-b63a3ed294b4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:23.613920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a4c74979-26c2-4382-8c66-f22322ecf705 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:23.615911 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a4c74979-26c2-4382-8c66-f22322ecf705 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:23.624142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a4c74979-26c2-4382-8c66-f22322ecf705 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:23.624751 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a4c74979-26c2-4382-8c66-f22322ecf705 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:23.625283 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a4c74979-26c2-4382-8c66-f22322ecf705 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:23.625980 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a4c74979-26c2-4382-8c66-f22322ecf705 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:23.626428 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a4c74979-26c2-4382-8c66-f22322ecf705 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:23.626849 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a4c74979-26c2-4382-8c66-f22322ecf705 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:23.700388 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-fc1ed5f8-6636-443c-a106-b63a3ed294b4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:23.710888 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-fc1ed5f8-6636-443c-a106-b63a3ed294b4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:23.712474 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-fc1ed5f8-6636-443c-a106-b63a3ed294b4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:23.713619 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-fc1ed5f8-6636-443c-a106-b63a3ed294b4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.192288 Aug 31 11:44:23.714173 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 134/270] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:23 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:23.718891 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-87de10b6-e538-43b8-95cd-0a25cfc4f7d2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:23.719791 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-87de10b6-e538-43b8-95cd-0a25cfc4f7d2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:23.730425 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-87de10b6-e538-43b8-95cd-0a25cfc4f7d2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:23.731029 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-87de10b6-e538-43b8-95cd-0a25cfc4f7d2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:23.731498 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-87de10b6-e538-43b8-95cd-0a25cfc4f7d2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:23.732168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-87de10b6-e538-43b8-95cd-0a25cfc4f7d2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:23.732682 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-87de10b6-e538-43b8-95cd-0a25cfc4f7d2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:23.733110 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-87de10b6-e538-43b8-95cd-0a25cfc4f7d2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:23.787470 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a4c74979-26c2-4382-8c66-f22322ecf705 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:23.795706 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a4c74979-26c2-4382-8c66-f22322ecf705 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.186997 Aug 31 11:44:23.796619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 137/271] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:23 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:23.835119 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f7e2691a-e540-4659-a675-34d5828bd699 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:23.835734 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f7e2691a-e540-4659-a675-34d5828bd699 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:23.843482 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f7e2691a-e540-4659-a675-34d5828bd699 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:23.843660 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f7e2691a-e540-4659-a675-34d5828bd699 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:23.844040 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f7e2691a-e540-4659-a675-34d5828bd699 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:23.844758 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f7e2691a-e540-4659-a675-34d5828bd699 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:23.845209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f7e2691a-e540-4659-a675-34d5828bd699 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:23.845629 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f7e2691a-e540-4659-a675-34d5828bd699 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:23.910886 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-87de10b6-e538-43b8-95cd-0a25cfc4f7d2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:23.920089 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-87de10b6-e538-43b8-95cd-0a25cfc4f7d2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.204855 Aug 31 11:44:23.920742 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 135/272] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:23 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:23.945479 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e06deda0-9891-4033-844b-a9b6ae477add tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:23.947020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e06deda0-9891-4033-844b-a9b6ae477add tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:23.956981 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e06deda0-9891-4033-844b-a9b6ae477add tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:23.957481 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e06deda0-9891-4033-844b-a9b6ae477add tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:23.957912 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e06deda0-9891-4033-844b-a9b6ae477add tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:23.958617 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e06deda0-9891-4033-844b-a9b6ae477add tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:23.959071 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e06deda0-9891-4033-844b-a9b6ae477add tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:23.959495 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e06deda0-9891-4033-844b-a9b6ae477add tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:24.009598 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f7e2691a-e540-4659-a675-34d5828bd699 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:24.020423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f7e2691a-e540-4659-a675-34d5828bd699 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.189953 Aug 31 11:44:24.021257 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 138/273] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:23 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:24.153457 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e06deda0-9891-4033-844b-a9b6ae477add tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:24.162007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e06deda0-9891-4033-844b-a9b6ae477add tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.228731 Aug 31 11:44:24.162476 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 136/274] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:23 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:24.737141 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-76ad6379-8a1b-494c-8895-54a1d1b9ad30 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:24.737948 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-76ad6379-8a1b-494c-8895-54a1d1b9ad30 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:24.744252 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76ad6379-8a1b-494c-8895-54a1d1b9ad30 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:24.744771 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76ad6379-8a1b-494c-8895-54a1d1b9ad30 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:24.745201 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76ad6379-8a1b-494c-8895-54a1d1b9ad30 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:24.745921 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76ad6379-8a1b-494c-8895-54a1d1b9ad30 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:24.746537 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76ad6379-8a1b-494c-8895-54a1d1b9ad30 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:24.746955 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76ad6379-8a1b-494c-8895-54a1d1b9ad30 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:24.818148 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3f4e3353-a8c8-4029-92e2-fbc0883e8a72 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:24.818753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3f4e3353-a8c8-4029-92e2-fbc0883e8a72 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:24.829960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3f4e3353-a8c8-4029-92e2-fbc0883e8a72 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:24.829960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3f4e3353-a8c8-4029-92e2-fbc0883e8a72 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:24.831100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3f4e3353-a8c8-4029-92e2-fbc0883e8a72 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:24.831777 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3f4e3353-a8c8-4029-92e2-fbc0883e8a72 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:24.832215 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3f4e3353-a8c8-4029-92e2-fbc0883e8a72 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:24.833146 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3f4e3353-a8c8-4029-92e2-fbc0883e8a72 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:24.894583 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-76ad6379-8a1b-494c-8895-54a1d1b9ad30 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:24.903653 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-76ad6379-8a1b-494c-8895-54a1d1b9ad30 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:24.905699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-76ad6379-8a1b-494c-8895-54a1d1b9ad30 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:24.907005 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-76ad6379-8a1b-494c-8895-54a1d1b9ad30 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.174636 Aug 31 11:44:24.907804 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 139/275] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:24 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:24.941395 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f6f0b922-8f1f-4182-93dc-581712e5069a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:24.941906 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f6f0b922-8f1f-4182-93dc-581712e5069a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:24.947737 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6f0b922-8f1f-4182-93dc-581712e5069a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:24.948215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6f0b922-8f1f-4182-93dc-581712e5069a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:24.948689 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6f0b922-8f1f-4182-93dc-581712e5069a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:24.949531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6f0b922-8f1f-4182-93dc-581712e5069a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:24.949818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6f0b922-8f1f-4182-93dc-581712e5069a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:24.950234 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6f0b922-8f1f-4182-93dc-581712e5069a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:25.072669 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3f4e3353-a8c8-4029-92e2-fbc0883e8a72 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:25.081275 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3f4e3353-a8c8-4029-92e2-fbc0883e8a72 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.267940 Aug 31 11:44:25.094051 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 137/276] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:24 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:25.095581 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f6f0b922-8f1f-4182-93dc-581712e5069a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:25.099310 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-69d4c037-09b2-4735-b8e9-cc52fadae68e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:25.099918 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-69d4c037-09b2-4735-b8e9-cc52fadae68e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:25.108350 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-69d4c037-09b2-4735-b8e9-cc52fadae68e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:25.108859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-69d4c037-09b2-4735-b8e9-cc52fadae68e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:25.109284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-69d4c037-09b2-4735-b8e9-cc52fadae68e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:25.109979 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-69d4c037-09b2-4735-b8e9-cc52fadae68e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:25.110588 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-69d4c037-09b2-4735-b8e9-cc52fadae68e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:25.111010 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-69d4c037-09b2-4735-b8e9-cc52fadae68e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:25.119283 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f6f0b922-8f1f-4182-93dc-581712e5069a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.181764 Aug 31 11:44:25.120135 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 140/277] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:24 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:25.184793 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1b7702bd-5627-43a1-a6ae-5e0d6b79f62c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:25.185396 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1b7702bd-5627-43a1-a6ae-5e0d6b79f62c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:25.192698 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b7702bd-5627-43a1-a6ae-5e0d6b79f62c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:25.193108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b7702bd-5627-43a1-a6ae-5e0d6b79f62c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:25.193535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b7702bd-5627-43a1-a6ae-5e0d6b79f62c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:25.194233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b7702bd-5627-43a1-a6ae-5e0d6b79f62c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:25.194678 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b7702bd-5627-43a1-a6ae-5e0d6b79f62c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:25.195098 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b7702bd-5627-43a1-a6ae-5e0d6b79f62c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:25.335175 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1b7702bd-5627-43a1-a6ae-5e0d6b79f62c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:25.347890 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1b7702bd-5627-43a1-a6ae-5e0d6b79f62c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.166810 Aug 31 11:44:25.348515 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 141/278] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:25 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:25.454930 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-69d4c037-09b2-4735-b8e9-cc52fadae68e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:25.465369 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-69d4c037-09b2-4735-b8e9-cc52fadae68e tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.370167 Aug 31 11:44:25.466255 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 138/279] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:25 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:25.931903 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b6cab2d9-12e3-4bdd-8dbd-86721d9cbd66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:25.933583 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b6cab2d9-12e3-4bdd-8dbd-86721d9cbd66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:25.941895 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b6cab2d9-12e3-4bdd-8dbd-86721d9cbd66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:25.943781 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b6cab2d9-12e3-4bdd-8dbd-86721d9cbd66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:25.944618 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b6cab2d9-12e3-4bdd-8dbd-86721d9cbd66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:25.945744 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b6cab2d9-12e3-4bdd-8dbd-86721d9cbd66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:25.946426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b6cab2d9-12e3-4bdd-8dbd-86721d9cbd66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:25.947058 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b6cab2d9-12e3-4bdd-8dbd-86721d9cbd66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:26.061414 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-5e7d5b07-5f39-4287-ae18-7a865f896118 req-65ba7cb5-b980-4c1e-8e80-d878887daa1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cfd5ee-9585-4f45-b34a-b0e87ae35723", "name": "network-vif-plugged", "status": "completed", "tag": "06958dff-75ee-4641-9552-3e8769a2f96e"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:44:26.079001 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-5e7d5b07-5f39-4287-ae18-7a865f896118 req-65ba7cb5-b980-4c1e-8e80-d878887daa1d service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:26.081005 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-5e7d5b07-5f39-4287-ae18-7a865f896118 req-65ba7cb5-b980-4c1e-8e80-d878887daa1d service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:26.081892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-5e7d5b07-5f39-4287-ae18-7a865f896118 req-65ba7cb5-b980-4c1e-8e80-d878887daa1d service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:26.098107 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-5e7d5b07-5f39-4287-ae18-7a865f896118 req-65ba7cb5-b980-4c1e-8e80-d878887daa1d service nova] Creating event network-vif-plugged:06958dff-75ee-4641-9552-3e8769a2f96e for instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 on hv-cinder-83976 Aug 31 11:44:26.103259 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-5e7d5b07-5f39-4287-ae18-7a865f896118 req-65ba7cb5-b980-4c1e-8e80-d878887daa1d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045623 Aug 31 11:44:26.104254 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 139/280] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:44:26.109604 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-29645f44-446a-4d5b-9470-9323615308e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:26.110506 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-29645f44-446a-4d5b-9470-9323615308e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:26.117906 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29645f44-446a-4d5b-9470-9323615308e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:26.118415 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29645f44-446a-4d5b-9470-9323615308e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:26.118850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29645f44-446a-4d5b-9470-9323615308e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:26.119615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29645f44-446a-4d5b-9470-9323615308e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:26.120115 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29645f44-446a-4d5b-9470-9323615308e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:26.121153 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29645f44-446a-4d5b-9470-9323615308e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:26.150208 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b6cab2d9-12e3-4bdd-8dbd-86721d9cbd66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:26.160984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b6cab2d9-12e3-4bdd-8dbd-86721d9cbd66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:26.163949 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b6cab2d9-12e3-4bdd-8dbd-86721d9cbd66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:26.165430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b6cab2d9-12e3-4bdd-8dbd-86721d9cbd66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.237777 Aug 31 11:44:26.166408 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 142/281] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:25 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:44:26.171792 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-df3dcccb-8401-4969-9ea2-d90e9c49ffad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:26.172909 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-df3dcccb-8401-4969-9ea2-d90e9c49ffad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:26.179714 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-df3dcccb-8401-4969-9ea2-d90e9c49ffad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:26.180450 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-df3dcccb-8401-4969-9ea2-d90e9c49ffad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:26.181291 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-df3dcccb-8401-4969-9ea2-d90e9c49ffad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:26.181978 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-df3dcccb-8401-4969-9ea2-d90e9c49ffad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:26.182493 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-df3dcccb-8401-4969-9ea2-d90e9c49ffad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:26.183133 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-df3dcccb-8401-4969-9ea2-d90e9c49ffad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:26.348850 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-df3dcccb-8401-4969-9ea2-d90e9c49ffad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:26.356859 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-df3dcccb-8401-4969-9ea2-d90e9c49ffad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.189068 Aug 31 11:44:26.357711 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 143/282] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:26 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:26.374896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-fc45e90c-7cf3-4ba7-8eec-38f0cfff6439 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:26.375606 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-fc45e90c-7cf3-4ba7-8eec-38f0cfff6439 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:26.383545 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fc45e90c-7cf3-4ba7-8eec-38f0cfff6439 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:26.384039 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fc45e90c-7cf3-4ba7-8eec-38f0cfff6439 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:26.384473 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fc45e90c-7cf3-4ba7-8eec-38f0cfff6439 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:26.385335 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fc45e90c-7cf3-4ba7-8eec-38f0cfff6439 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:26.385833 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fc45e90c-7cf3-4ba7-8eec-38f0cfff6439 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:26.386374 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fc45e90c-7cf3-4ba7-8eec-38f0cfff6439 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:26.399896 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-29645f44-446a-4d5b-9470-9323615308e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:26.408201 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-29645f44-446a-4d5b-9470-9323615308e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.302679 Aug 31 11:44:26.409004 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 140/283] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:26 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:26.487765 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-90f1a176-7c45-498e-8b8a-8c839bb1151a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:26.488902 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-90f1a176-7c45-498e-8b8a-8c839bb1151a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:26.494821 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-90f1a176-7c45-498e-8b8a-8c839bb1151a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:26.495373 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-90f1a176-7c45-498e-8b8a-8c839bb1151a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:26.496045 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-90f1a176-7c45-498e-8b8a-8c839bb1151a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:26.496994 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-90f1a176-7c45-498e-8b8a-8c839bb1151a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:26.497665 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-90f1a176-7c45-498e-8b8a-8c839bb1151a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:26.498288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-90f1a176-7c45-498e-8b8a-8c839bb1151a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:26.547358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-fc45e90c-7cf3-4ba7-8eec-38f0cfff6439 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:26.556026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-fc45e90c-7cf3-4ba7-8eec-38f0cfff6439 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.185771 Aug 31 11:44:26.556811 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 144/284] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:26 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:26.653249 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-90f1a176-7c45-498e-8b8a-8c839bb1151a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:26.656171 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-90f1a176-7c45-498e-8b8a-8c839bb1151a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.172816 Aug 31 11:44:26.656986 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 141/285] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:26 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:27.193694 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5b814ac6-5b9c-4ce4-afb1-ac96c1e4c620 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:27.194305 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5b814ac6-5b9c-4ce4-afb1-ac96c1e4c620 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:27.200167 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5b814ac6-5b9c-4ce4-afb1-ac96c1e4c620 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:27.200897 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5b814ac6-5b9c-4ce4-afb1-ac96c1e4c620 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:27.201324 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5b814ac6-5b9c-4ce4-afb1-ac96c1e4c620 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:27.202261 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5b814ac6-5b9c-4ce4-afb1-ac96c1e4c620 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:27.202715 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5b814ac6-5b9c-4ce4-afb1-ac96c1e4c620 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:27.203291 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5b814ac6-5b9c-4ce4-afb1-ac96c1e4c620 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:27.371831 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5b814ac6-5b9c-4ce4-afb1-ac96c1e4c620 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:27.381661 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-29eb61f5-3d32-4ee8-8433-916ee07aaed8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:27.382859 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5b814ac6-5b9c-4ce4-afb1-ac96c1e4c620 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:27.384465 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5b814ac6-5b9c-4ce4-afb1-ac96c1e4c620 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:27.385059 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-29eb61f5-3d32-4ee8-8433-916ee07aaed8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:27.385611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5b814ac6-5b9c-4ce4-afb1-ac96c1e4c620 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.196498 Aug 31 11:44:27.386172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 145/286] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:27 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:27.396390 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29eb61f5-3d32-4ee8-8433-916ee07aaed8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:27.398154 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29eb61f5-3d32-4ee8-8433-916ee07aaed8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:27.398596 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29eb61f5-3d32-4ee8-8433-916ee07aaed8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:27.399311 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29eb61f5-3d32-4ee8-8433-916ee07aaed8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:27.399774 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29eb61f5-3d32-4ee8-8433-916ee07aaed8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:27.400185 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29eb61f5-3d32-4ee8-8433-916ee07aaed8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:27.431430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a8aef1c3-8126-4862-ae7c-0a800f06332f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:27.432449 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a8aef1c3-8126-4862-ae7c-0a800f06332f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:27.439170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a8aef1c3-8126-4862-ae7c-0a800f06332f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:27.440220 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a8aef1c3-8126-4862-ae7c-0a800f06332f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:27.441488 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a8aef1c3-8126-4862-ae7c-0a800f06332f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:27.442536 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a8aef1c3-8126-4862-ae7c-0a800f06332f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:27.442988 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a8aef1c3-8126-4862-ae7c-0a800f06332f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:27.443410 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a8aef1c3-8126-4862-ae7c-0a800f06332f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:27.842365 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-29eb61f5-3d32-4ee8-8433-916ee07aaed8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:27.860105 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a8aef1c3-8126-4862-ae7c-0a800f06332f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:27.868770 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-29eb61f5-3d32-4ee8-8433-916ee07aaed8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.477947 Aug 31 11:44:27.872835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 142/287] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:27 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:27.892742 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a8aef1c3-8126-4862-ae7c-0a800f06332f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.447811 Aug 31 11:44:27.897158 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 146/288] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:27 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:27.905926 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e1f76d25-4288-4a37-a577-4c67bece5b09 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:27.912516 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e1f76d25-4288-4a37-a577-4c67bece5b09 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:27.920303 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3f6fa761-ba49-4ea8-8c5d-d99d2e0ea337 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:27.928192 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3f6fa761-ba49-4ea8-8c5d-d99d2e0ea337 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:27.950688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1f76d25-4288-4a37-a577-4c67bece5b09 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:27.955720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1f76d25-4288-4a37-a577-4c67bece5b09 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:27.956527 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1f76d25-4288-4a37-a577-4c67bece5b09 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:27.958487 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1f76d25-4288-4a37-a577-4c67bece5b09 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:27.959684 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3f6fa761-ba49-4ea8-8c5d-d99d2e0ea337 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:27.964470 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3f6fa761-ba49-4ea8-8c5d-d99d2e0ea337 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:27.964782 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1f76d25-4288-4a37-a577-4c67bece5b09 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:27.965710 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1f76d25-4288-4a37-a577-4c67bece5b09 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:27.966547 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3f6fa761-ba49-4ea8-8c5d-d99d2e0ea337 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:27.975372 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3f6fa761-ba49-4ea8-8c5d-d99d2e0ea337 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:27.976835 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3f6fa761-ba49-4ea8-8c5d-d99d2e0ea337 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:27.977597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3f6fa761-ba49-4ea8-8c5d-d99d2e0ea337 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:28.775247 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3f6fa761-ba49-4ea8-8c5d-d99d2e0ea337 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:28.780674 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:28.816297 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3f6fa761-ba49-4ea8-8c5d-d99d2e0ea337 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.910332 Aug 31 11:44:28.818116 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 147/289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:27 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:28.836144 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-97fd3b5f-6f06-492c-ab99-103ff1c69df3 req-569ca084-b536-4251-8c9a-eaab0ba35675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee843c31-1261-43ec-8358-d9bdceb3fb26", "name": "network-vif-plugged", "status": "completed", "tag": "736b1786-49b6-4725-ae4c-14888fe4a5e3"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:44:28.889666 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-97fd3b5f-6f06-492c-ab99-103ff1c69df3 req-569ca084-b536-4251-8c9a-eaab0ba35675 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:28.891117 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-97fd3b5f-6f06-492c-ab99-103ff1c69df3 req-569ca084-b536-4251-8c9a-eaab0ba35675 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:28.891566 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-97fd3b5f-6f06-492c-ab99-103ff1c69df3 req-569ca084-b536-4251-8c9a-eaab0ba35675 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:28.905100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e1f76d25-4288-4a37-a577-4c67bece5b09 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:28.914568 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e1f76d25-4288-4a37-a577-4c67bece5b09 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 1.040081 Aug 31 11:44:28.915146 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 143/290] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:27 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:28.945955 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-40af9ea7-04b0-4752-861a-37729717c429 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:28.946661 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-40af9ea7-04b0-4752-861a-37729717c429 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:28.950452 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-97fd3b5f-6f06-492c-ab99-103ff1c69df3 req-569ca084-b536-4251-8c9a-eaab0ba35675 service nova] Creating event network-vif-plugged:736b1786-49b6-4725-ae4c-14888fe4a5e3 for instance ee843c31-1261-43ec-8358-d9bdceb3fb26 on hv-cinder-83976 Aug 31 11:44:28.953028 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40af9ea7-04b0-4752-861a-37729717c429 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:28.953498 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40af9ea7-04b0-4752-861a-37729717c429 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:28.953935 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40af9ea7-04b0-4752-861a-37729717c429 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:28.954625 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40af9ea7-04b0-4752-861a-37729717c429 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:28.955204 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40af9ea7-04b0-4752-861a-37729717c429 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:28.955685 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40af9ea7-04b0-4752-861a-37729717c429 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:28.970305 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-97fd3b5f-6f06-492c-ab99-103ff1c69df3 req-569ca084-b536-4251-8c9a-eaab0ba35675 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149825 Aug 31 11:44:28.972413 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 148/291] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:44:28.978041 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-11d3fc95-136b-4074-a858-297010bc752a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:28.978732 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-11d3fc95-136b-4074-a858-297010bc752a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:28.991008 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11d3fc95-136b-4074-a858-297010bc752a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:28.993058 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11d3fc95-136b-4074-a858-297010bc752a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:28.994354 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11d3fc95-136b-4074-a858-297010bc752a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:28.995269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11d3fc95-136b-4074-a858-297010bc752a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:28.995902 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11d3fc95-136b-4074-a858-297010bc752a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:28.996685 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11d3fc95-136b-4074-a858-297010bc752a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:29.254012 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-40af9ea7-04b0-4752-861a-37729717c429 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:29.264205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-40af9ea7-04b0-4752-861a-37729717c429 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:29.265987 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-40af9ea7-04b0-4752-861a-37729717c429 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:29.267191 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-40af9ea7-04b0-4752-861a-37729717c429 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.325439 Aug 31 11:44:29.281648 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 144/292] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:28 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:29.289774 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bc193857-d808-435b-b27a-0327931a887b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:29.290345 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-bc193857-d808-435b-b27a-0327931a887b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:29.296776 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc193857-d808-435b-b27a-0327931a887b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:29.297503 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc193857-d808-435b-b27a-0327931a887b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:29.298024 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc193857-d808-435b-b27a-0327931a887b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:29.300247 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc193857-d808-435b-b27a-0327931a887b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:29.300910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc193857-d808-435b-b27a-0327931a887b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:29.301684 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc193857-d808-435b-b27a-0327931a887b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:29.370579 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-11d3fc95-136b-4074-a858-297010bc752a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:29.382158 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-11d3fc95-136b-4074-a858-297010bc752a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.407624 Aug 31 11:44:29.395120 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 149/293] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:28 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:29.616632 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-bc193857-d808-435b-b27a-0327931a887b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:29.627918 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-bc193857-d808-435b-b27a-0327931a887b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.345077 Aug 31 11:44:29.629001 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 145/294] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:29 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:29.839692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1b051799-a4f4-4361-ba6c-3abecf7942c1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:29.840623 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1b051799-a4f4-4361-ba6c-3abecf7942c1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:29.849121 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b051799-a4f4-4361-ba6c-3abecf7942c1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:29.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b051799-a4f4-4361-ba6c-3abecf7942c1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:29.850248 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b051799-a4f4-4361-ba6c-3abecf7942c1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:29.851079 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b051799-a4f4-4361-ba6c-3abecf7942c1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:29.851563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b051799-a4f4-4361-ba6c-3abecf7942c1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:29.851990 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b051799-a4f4-4361-ba6c-3abecf7942c1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:29.937846 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7b16b0f6-fa2b-485c-a62d-7814ea9d5af6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:29.940307 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7b16b0f6-fa2b-485c-a62d-7814ea9d5af6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:29.950712 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b16b0f6-fa2b-485c-a62d-7814ea9d5af6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:29.952394 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b16b0f6-fa2b-485c-a62d-7814ea9d5af6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:29.953526 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b16b0f6-fa2b-485c-a62d-7814ea9d5af6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:29.954849 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b16b0f6-fa2b-485c-a62d-7814ea9d5af6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:29.962219 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b16b0f6-fa2b-485c-a62d-7814ea9d5af6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:29.962865 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b16b0f6-fa2b-485c-a62d-7814ea9d5af6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:30.173317 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7b16b0f6-fa2b-485c-a62d-7814ea9d5af6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:30.184680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7b16b0f6-fa2b-485c-a62d-7814ea9d5af6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.251823 Aug 31 11:44:30.199480 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 146/295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:29 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:30.294857 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c3542603-f8ca-471a-9c89-5fa9765374d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:30.295494 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c3542603-f8ca-471a-9c89-5fa9765374d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:30.302586 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3542603-f8ca-471a-9c89-5fa9765374d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:30.303429 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3542603-f8ca-471a-9c89-5fa9765374d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:30.304105 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3542603-f8ca-471a-9c89-5fa9765374d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:30.304934 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3542603-f8ca-471a-9c89-5fa9765374d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:30.305448 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3542603-f8ca-471a-9c89-5fa9765374d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:30.305934 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3542603-f8ca-471a-9c89-5fa9765374d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:30.373454 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1b051799-a4f4-4361-ba6c-3abecf7942c1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:30.382995 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1b051799-a4f4-4361-ba6c-3abecf7942c1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.547489 Aug 31 11:44:30.383582 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 150/296] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:29 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:30.407201 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ca84f8f6-dc39-4cc7-b415-498a240bb773 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:30.407731 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ca84f8f6-dc39-4cc7-b415-498a240bb773 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:30.415730 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca84f8f6-dc39-4cc7-b415-498a240bb773 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:30.416518 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca84f8f6-dc39-4cc7-b415-498a240bb773 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:30.417180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca84f8f6-dc39-4cc7-b415-498a240bb773 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:30.418036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca84f8f6-dc39-4cc7-b415-498a240bb773 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:30.418730 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca84f8f6-dc39-4cc7-b415-498a240bb773 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:30.419432 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca84f8f6-dc39-4cc7-b415-498a240bb773 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:30.566574 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c3542603-f8ca-471a-9c89-5fa9765374d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:30.577402 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c3542603-f8ca-471a-9c89-5fa9765374d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:30.579130 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c3542603-f8ca-471a-9c89-5fa9765374d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:30.580534 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c3542603-f8ca-471a-9c89-5fa9765374d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.289860 Aug 31 11:44:30.581632 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 147/297] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:30 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:44:30.607604 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ca84f8f6-dc39-4cc7-b415-498a240bb773 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:30.615927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ca84f8f6-dc39-4cc7-b415-498a240bb773 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.213720 Aug 31 11:44:30.616515 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 151/298] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:30 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:30.648655 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-02ad86cf-cbed-4121-88d3-511ff6f88f2f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:30.649513 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-02ad86cf-cbed-4121-88d3-511ff6f88f2f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:30.655991 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-02ad86cf-cbed-4121-88d3-511ff6f88f2f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:30.656430 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-02ad86cf-cbed-4121-88d3-511ff6f88f2f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:30.656978 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-02ad86cf-cbed-4121-88d3-511ff6f88f2f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:30.657752 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-02ad86cf-cbed-4121-88d3-511ff6f88f2f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:30.658959 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-02ad86cf-cbed-4121-88d3-511ff6f88f2f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:30.659437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-02ad86cf-cbed-4121-88d3-511ff6f88f2f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:30.867761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-02ad86cf-cbed-4121-88d3-511ff6f88f2f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:30.875572 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-02ad86cf-cbed-4121-88d3-511ff6f88f2f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.230754 Aug 31 11:44:30.876144 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 148/299] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:30 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:31.212154 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9b404e7b-f955-46ff-9532-57a866b23858 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:31.212935 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9b404e7b-f955-46ff-9532-57a866b23858 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:31.219083 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9b404e7b-f955-46ff-9532-57a866b23858 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:31.219563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9b404e7b-f955-46ff-9532-57a866b23858 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:31.219996 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9b404e7b-f955-46ff-9532-57a866b23858 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:31.221244 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9b404e7b-f955-46ff-9532-57a866b23858 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:31.221244 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9b404e7b-f955-46ff-9532-57a866b23858 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:31.221873 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9b404e7b-f955-46ff-9532-57a866b23858 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:31.404831 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d0d5ba1d-06cf-4ed8-b94c-288828349851 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:31.406248 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d0d5ba1d-06cf-4ed8-b94c-288828349851 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:31.413276 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0d5ba1d-06cf-4ed8-b94c-288828349851 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:31.419581 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0d5ba1d-06cf-4ed8-b94c-288828349851 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:31.420283 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0d5ba1d-06cf-4ed8-b94c-288828349851 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:31.421155 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0d5ba1d-06cf-4ed8-b94c-288828349851 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:31.421744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0d5ba1d-06cf-4ed8-b94c-288828349851 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:31.422273 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0d5ba1d-06cf-4ed8-b94c-288828349851 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:31.610887 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9b404e7b-f955-46ff-9532-57a866b23858 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:31.612426 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d0d5ba1d-06cf-4ed8-b94c-288828349851 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:31.616663 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:31.622894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9b404e7b-f955-46ff-9532-57a866b23858 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.418897 Aug 31 11:44:31.623116 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d0d5ba1d-06cf-4ed8-b94c-288828349851 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.223187 Aug 31 11:44:31.623485 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 152/300] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:31 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:31.624314 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 149/301] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:31 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:31.640470 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b93f4883-403a-4391-956f-3189767f56b2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:31.641102 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b93f4883-403a-4391-956f-3189767f56b2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:31.649236 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4d0dce55-e8f2-467e-a13c-e60ef8cb3e30 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:31.649846 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4d0dce55-e8f2-467e-a13c-e60ef8cb3e30 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:31.654614 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b93f4883-403a-4391-956f-3189767f56b2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:31.655086 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b93f4883-403a-4391-956f-3189767f56b2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:31.655518 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b93f4883-403a-4391-956f-3189767f56b2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:31.656214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b93f4883-403a-4391-956f-3189767f56b2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:31.660523 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b93f4883-403a-4391-956f-3189767f56b2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:31.660970 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b93f4883-403a-4391-956f-3189767f56b2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:31.667831 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d0dce55-e8f2-467e-a13c-e60ef8cb3e30 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:31.668579 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d0dce55-e8f2-467e-a13c-e60ef8cb3e30 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:31.669439 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d0dce55-e8f2-467e-a13c-e60ef8cb3e30 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:31.670306 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d0dce55-e8f2-467e-a13c-e60ef8cb3e30 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:31.670943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d0dce55-e8f2-467e-a13c-e60ef8cb3e30 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:31.671463 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d0dce55-e8f2-467e-a13c-e60ef8cb3e30 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:31.841012 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b93f4883-403a-4391-956f-3189767f56b2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:31.849998 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4d0dce55-e8f2-467e-a13c-e60ef8cb3e30 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:31.857076 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b93f4883-403a-4391-956f-3189767f56b2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:31.859198 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b93f4883-403a-4391-956f-3189767f56b2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:31.860413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4d0dce55-e8f2-467e-a13c-e60ef8cb3e30 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.226362 Aug 31 11:44:31.860898 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b93f4883-403a-4391-956f-3189767f56b2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.236307 Aug 31 11:44:31.861905 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 150/302] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:31 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:31.878476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 153/303] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:31 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:31.898756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b9fe4ea1-dfb6-4caf-829f-94760047949a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:31.899362 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b9fe4ea1-dfb6-4caf-829f-94760047949a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:31.906268 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b9fe4ea1-dfb6-4caf-829f-94760047949a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:31.907118 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b9fe4ea1-dfb6-4caf-829f-94760047949a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:31.907906 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b9fe4ea1-dfb6-4caf-829f-94760047949a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:31.909284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b9fe4ea1-dfb6-4caf-829f-94760047949a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:31.910058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b9fe4ea1-dfb6-4caf-829f-94760047949a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:31.910744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b9fe4ea1-dfb6-4caf-829f-94760047949a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:32.083132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b9fe4ea1-dfb6-4caf-829f-94760047949a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:32.092319 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b9fe4ea1-dfb6-4caf-829f-94760047949a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.197263 Aug 31 11:44:32.093673 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 151/304] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:31 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:32.327619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-b1f74401-30a1-4298-8b56-0237e92caaf9 req-8bc11b48-e378-4e8d-a36e-82d11bcea523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab", "name": "network-vif-plugged", "status": "completed", "tag": "12ad6e71-b8c7-4384-9cc1-59620a27059b"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:44:32.338719 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-b1f74401-30a1-4298-8b56-0237e92caaf9 req-8bc11b48-e378-4e8d-a36e-82d11bcea523 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:32.340048 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-b1f74401-30a1-4298-8b56-0237e92caaf9 req-8bc11b48-e378-4e8d-a36e-82d11bcea523 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:32.340614 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-b1f74401-30a1-4298-8b56-0237e92caaf9 req-8bc11b48-e378-4e8d-a36e-82d11bcea523 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:32.353206 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-b1f74401-30a1-4298-8b56-0237e92caaf9 req-8bc11b48-e378-4e8d-a36e-82d11bcea523 service nova] Creating event network-vif-plugged:12ad6e71-b8c7-4384-9cc1-59620a27059b for instance 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab on hv-cinder-83976 Aug 31 11:44:32.359145 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-b1f74401-30a1-4298-8b56-0237e92caaf9 req-8bc11b48-e378-4e8d-a36e-82d11bcea523 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035382 Aug 31 11:44:32.359827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 154/305] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:44:32.644755 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-53d75133-6da2-495a-8d8b-787a6901e442 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:32.645360 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-53d75133-6da2-495a-8d8b-787a6901e442 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:32.647310 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e97fd5cb-9ad5-44ee-9bc8-00bebb73dbc3 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:32.647888 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e97fd5cb-9ad5-44ee-9bc8-00bebb73dbc3 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:32.652446 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-53d75133-6da2-495a-8d8b-787a6901e442 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:32.652960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-53d75133-6da2-495a-8d8b-787a6901e442 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:32.653439 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-53d75133-6da2-495a-8d8b-787a6901e442 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:32.654129 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-53d75133-6da2-495a-8d8b-787a6901e442 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:32.654589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-53d75133-6da2-495a-8d8b-787a6901e442 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:32.654998 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-53d75133-6da2-495a-8d8b-787a6901e442 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:32.655247 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e97fd5cb-9ad5-44ee-9bc8-00bebb73dbc3 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:32.656169 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e97fd5cb-9ad5-44ee-9bc8-00bebb73dbc3 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:32.656750 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e97fd5cb-9ad5-44ee-9bc8-00bebb73dbc3 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:32.658632 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e97fd5cb-9ad5-44ee-9bc8-00bebb73dbc3 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:32.659546 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e97fd5cb-9ad5-44ee-9bc8-00bebb73dbc3 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:32.660059 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e97fd5cb-9ad5-44ee-9bc8-00bebb73dbc3 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:32.826594 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-53d75133-6da2-495a-8d8b-787a6901e442 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:32.832706 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e97fd5cb-9ad5-44ee-9bc8-00bebb73dbc3 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:32.836477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-53d75133-6da2-495a-8d8b-787a6901e442 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1366 microversion: 2.1 time: 0.196440 Aug 31 11:44:32.837073 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 152/306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:32 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:32.847947 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e97fd5cb-9ad5-44ee-9bc8-00bebb73dbc3 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.197939 Aug 31 11:44:32.847947 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 155/307] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:32 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:32.886449 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-975d8e02-3ac4-4d3e-ba28-571979e8aa2c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:32.887060 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-975d8e02-3ac4-4d3e-ba28-571979e8aa2c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:32.893664 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-975d8e02-3ac4-4d3e-ba28-571979e8aa2c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:32.894150 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-975d8e02-3ac4-4d3e-ba28-571979e8aa2c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:32.894579 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-975d8e02-3ac4-4d3e-ba28-571979e8aa2c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:32.895352 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-975d8e02-3ac4-4d3e-ba28-571979e8aa2c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:32.896065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-975d8e02-3ac4-4d3e-ba28-571979e8aa2c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:32.896506 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-975d8e02-3ac4-4d3e-ba28-571979e8aa2c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:32.905297 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-96ac368e-87da-4d32-93e1-f55a944cb6ff tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:32.905899 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-96ac368e-87da-4d32-93e1-f55a944cb6ff tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:32.913499 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-96ac368e-87da-4d32-93e1-f55a944cb6ff tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:32.913677 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-96ac368e-87da-4d32-93e1-f55a944cb6ff tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:32.914025 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-96ac368e-87da-4d32-93e1-f55a944cb6ff tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:32.914827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-96ac368e-87da-4d32-93e1-f55a944cb6ff tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:32.915363 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-96ac368e-87da-4d32-93e1-f55a944cb6ff tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:32.915838 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-96ac368e-87da-4d32-93e1-f55a944cb6ff tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:33.041968 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-975d8e02-3ac4-4d3e-ba28-571979e8aa2c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:33.056058 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-975d8e02-3ac4-4d3e-ba28-571979e8aa2c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.173285 Aug 31 11:44:33.056773 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 156/308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:32 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:33.104255 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-96ac368e-87da-4d32-93e1-f55a944cb6ff tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:33.113249 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-96ac368e-87da-4d32-93e1-f55a944cb6ff tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:33.114789 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-96ac368e-87da-4d32-93e1-f55a944cb6ff tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:33.115892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-96ac368e-87da-4d32-93e1-f55a944cb6ff tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1408 microversion: 2.20 time: 0.217446 Aug 31 11:44:33.116105 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-192c13ea-66ba-4808-93a6-35d3b4d32806 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:33.116755 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-192c13ea-66ba-4808-93a6-35d3b4d32806 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:33.116939 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 153/309] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:32 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:33.137785 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-192c13ea-66ba-4808-93a6-35d3b4d32806 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:33.138277 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-192c13ea-66ba-4808-93a6-35d3b4d32806 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:33.138714 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-192c13ea-66ba-4808-93a6-35d3b4d32806 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:33.139423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-192c13ea-66ba-4808-93a6-35d3b4d32806 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:33.139859 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-192c13ea-66ba-4808-93a6-35d3b4d32806 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:33.140280 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-192c13ea-66ba-4808-93a6-35d3b4d32806 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:33.291183 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-192c13ea-66ba-4808-93a6-35d3b4d32806 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:33.299771 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-192c13ea-66ba-4808-93a6-35d3b4d32806 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1321 microversion: 2.1 time: 0.187832 Aug 31 11:44:33.300753 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 157/310] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:33 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:33.859884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b4a1b57f-e6cc-4754-9011-80aa92a5c57c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:33.861712 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b4a1b57f-e6cc-4754-9011-80aa92a5c57c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:33.862172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c595c696-2d45-4fde-8b16-d44a06705858 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:33.862827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c595c696-2d45-4fde-8b16-d44a06705858 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:33.869583 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4a1b57f-e6cc-4754-9011-80aa92a5c57c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:33.869963 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c595c696-2d45-4fde-8b16-d44a06705858 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:33.870070 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4a1b57f-e6cc-4754-9011-80aa92a5c57c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:33.870448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c595c696-2d45-4fde-8b16-d44a06705858 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:33.870627 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4a1b57f-e6cc-4754-9011-80aa92a5c57c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:33.871262 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4a1b57f-e6cc-4754-9011-80aa92a5c57c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:33.871436 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c595c696-2d45-4fde-8b16-d44a06705858 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:33.871711 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4a1b57f-e6cc-4754-9011-80aa92a5c57c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:33.872132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4a1b57f-e6cc-4754-9011-80aa92a5c57c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:33.873185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c595c696-2d45-4fde-8b16-d44a06705858 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:33.873777 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c595c696-2d45-4fde-8b16-d44a06705858 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:33.874514 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c595c696-2d45-4fde-8b16-d44a06705858 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:34.030848 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b4a1b57f-e6cc-4754-9011-80aa92a5c57c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:34.032384 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c595c696-2d45-4fde-8b16-d44a06705858 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:34.039451 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b4a1b57f-e6cc-4754-9011-80aa92a5c57c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1555 microversion: 2.1 time: 0.185136 Aug 31 11:44:34.040165 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 154/311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:33 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:34.046734 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c595c696-2d45-4fde-8b16-d44a06705858 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.188978 Aug 31 11:44:34.047423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 158/312] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:33 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:34.063419 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4f0eaace-ef41-40cf-9100-0c773c1ffa8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:34.064158 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4f0eaace-ef41-40cf-9100-0c773c1ffa8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:34.070715 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f0eaace-ef41-40cf-9100-0c773c1ffa8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:34.071196 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f0eaace-ef41-40cf-9100-0c773c1ffa8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:34.071633 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f0eaace-ef41-40cf-9100-0c773c1ffa8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:34.072375 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f0eaace-ef41-40cf-9100-0c773c1ffa8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:34.072964 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f0eaace-ef41-40cf-9100-0c773c1ffa8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:34.073354 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f0eaace-ef41-40cf-9100-0c773c1ffa8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:34.077975 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8684d4c2-47a1-47a6-b0e3-35162ec0dcd0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:34.078726 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8684d4c2-47a1-47a6-b0e3-35162ec0dcd0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:34.086409 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8684d4c2-47a1-47a6-b0e3-35162ec0dcd0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:34.086899 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8684d4c2-47a1-47a6-b0e3-35162ec0dcd0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:34.087425 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8684d4c2-47a1-47a6-b0e3-35162ec0dcd0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:34.088125 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8684d4c2-47a1-47a6-b0e3-35162ec0dcd0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:34.088739 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8684d4c2-47a1-47a6-b0e3-35162ec0dcd0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:34.089163 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8684d4c2-47a1-47a6-b0e3-35162ec0dcd0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:34.197727 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4f0eaace-ef41-40cf-9100-0c773c1ffa8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138430 Aug 31 11:44:34.201041 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 155/313] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 31 11:44:34 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:44:34.206809 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-24573e7b-84f4-4896-b2ec-43dc792c22a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:34.207413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-24573e7b-84f4-4896-b2ec-43dc792c22a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:34.214019 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-24573e7b-84f4-4896-b2ec-43dc792c22a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:34.214507 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-24573e7b-84f4-4896-b2ec-43dc792c22a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:34.214937 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-24573e7b-84f4-4896-b2ec-43dc792c22a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:34.215632 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-24573e7b-84f4-4896-b2ec-43dc792c22a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:34.216115 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-24573e7b-84f4-4896-b2ec-43dc792c22a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:34.216579 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-24573e7b-84f4-4896-b2ec-43dc792c22a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:34.306576 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8684d4c2-47a1-47a6-b0e3-35162ec0dcd0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:34.319576 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8684d4c2-47a1-47a6-b0e3-35162ec0dcd0 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1360 microversion: 2.1 time: 0.245467 Aug 31 11:44:34.327297 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 159/314] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:34 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1360 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:34.333091 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ceb3a459-38cb-4e16-98c0-4cca9a17d100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:34.333901 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ceb3a459-38cb-4e16-98c0-4cca9a17d100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:34.348678 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ceb3a459-38cb-4e16-98c0-4cca9a17d100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:34.349096 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ceb3a459-38cb-4e16-98c0-4cca9a17d100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:34.349527 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ceb3a459-38cb-4e16-98c0-4cca9a17d100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:34.350240 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ceb3a459-38cb-4e16-98c0-4cca9a17d100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:34.355849 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ceb3a459-38cb-4e16-98c0-4cca9a17d100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:34.356378 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ceb3a459-38cb-4e16-98c0-4cca9a17d100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:34.405812 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-24573e7b-84f4-4896-b2ec-43dc792c22a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:34.417790 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-24573e7b-84f4-4896-b2ec-43dc792c22a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:34.419586 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-24573e7b-84f4-4896-b2ec-43dc792c22a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:34.421767 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-24573e7b-84f4-4896-b2ec-43dc792c22a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1600 microversion: 2.20 time: 0.219565 Aug 31 11:44:34.422895 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 156/315] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:44:34 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1600 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:44:34.447001 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-def577a5-9657-4116-9af1-e2bff6b66c97 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:34.448221 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-def577a5-9657-4116-9af1-e2bff6b66c97 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:34.461832 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-def577a5-9657-4116-9af1-e2bff6b66c97 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:34.462613 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-def577a5-9657-4116-9af1-e2bff6b66c97 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:34.463311 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-def577a5-9657-4116-9af1-e2bff6b66c97 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:34.464581 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-def577a5-9657-4116-9af1-e2bff6b66c97 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:34.468806 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-def577a5-9657-4116-9af1-e2bff6b66c97 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:34.470269 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-def577a5-9657-4116-9af1-e2bff6b66c97 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:34.603866 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-def577a5-9657-4116-9af1-e2bff6b66c97 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.161973 Aug 31 11:44:34.605089 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 157/316] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Aug 31 11:44:34 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:44:34.706680 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ceb3a459-38cb-4e16-98c0-4cca9a17d100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:34.718889 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ceb3a459-38cb-4e16-98c0-4cca9a17d100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1515 microversion: 2.1 time: 0.390234 Aug 31 11:44:34.719748 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 160/317] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:34 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1515 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:34.743683 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6eddb0f3-5291-488f-9ea9-dfa8334e1d45 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:44:34.746497 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6eddb0f3-5291-488f-9ea9-dfa8334e1d45 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:34.764833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6eddb0f3-5291-488f-9ea9-dfa8334e1d45 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:34.765339 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6eddb0f3-5291-488f-9ea9-dfa8334e1d45 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:34.765761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6eddb0f3-5291-488f-9ea9-dfa8334e1d45 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:34.766461 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6eddb0f3-5291-488f-9ea9-dfa8334e1d45 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:34.766912 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6eddb0f3-5291-488f-9ea9-dfa8334e1d45 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:34.767410 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6eddb0f3-5291-488f-9ea9-dfa8334e1d45 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:34.795109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-6eddb0f3-5291-488f-9ea9-dfa8334e1d45 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lazy-loading 'flavor' on Instance uuid a562f1ce-b46b-464a-9a4c-a9963f56dceb {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:44:34.923031 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6eddb0f3-5291-488f-9ea9-dfa8334e1d45 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "POST /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb/action" status: 200 len: 32 microversion: 2.1 time: 0.185529 Aug 31 11:44:34.925326 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 158/318] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 31 11:44:34 2022] POST /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:44:34.934973 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2b5608f9-331a-4770-8ff7-80d15573cbad tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:34.935620 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2b5608f9-331a-4770-8ff7-80d15573cbad tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:34.943341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2b5608f9-331a-4770-8ff7-80d15573cbad tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:34.943837 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2b5608f9-331a-4770-8ff7-80d15573cbad tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:34.944447 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2b5608f9-331a-4770-8ff7-80d15573cbad tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:34.945402 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2b5608f9-331a-4770-8ff7-80d15573cbad tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:34.945857 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2b5608f9-331a-4770-8ff7-80d15573cbad tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:34.946278 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2b5608f9-331a-4770-8ff7-80d15573cbad tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:35.070970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a59e48a1-217f-4b16-844a-a61049777222 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:35.071736 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a59e48a1-217f-4b16-844a-a61049777222 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:35.078444 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a59e48a1-217f-4b16-844a-a61049777222 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:35.079254 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a59e48a1-217f-4b16-844a-a61049777222 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:35.079938 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a59e48a1-217f-4b16-844a-a61049777222 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:35.081462 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a59e48a1-217f-4b16-844a-a61049777222 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:35.082034 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a59e48a1-217f-4b16-844a-a61049777222 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:35.082568 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a59e48a1-217f-4b16-844a-a61049777222 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:35.438620 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2b5608f9-331a-4770-8ff7-80d15573cbad tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:35.449114 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2b5608f9-331a-4770-8ff7-80d15573cbad tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.518145 Aug 31 11:44:35.465105 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 161/319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:34 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:44:35.473830 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-dac4f8c8-1e4f-45b9-be08-3f23d377675d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:35.476662 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-dac4f8c8-1e4f-45b9-be08-3f23d377675d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:35.487913 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dac4f8c8-1e4f-45b9-be08-3f23d377675d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:35.488710 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dac4f8c8-1e4f-45b9-be08-3f23d377675d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:35.489400 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dac4f8c8-1e4f-45b9-be08-3f23d377675d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:35.490444 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dac4f8c8-1e4f-45b9-be08-3f23d377675d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:35.491870 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dac4f8c8-1e4f-45b9-be08-3f23d377675d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:35.492811 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dac4f8c8-1e4f-45b9-be08-3f23d377675d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:35.675712 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a59e48a1-217f-4b16-844a-a61049777222 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:35.694043 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a59e48a1-217f-4b16-844a-a61049777222 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1314 microversion: 2.1 time: 0.627482 Aug 31 11:44:35.694890 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 159/320] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:35 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:35.878923 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-dac4f8c8-1e4f-45b9-be08-3f23d377675d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:35.895477 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-dac4f8c8-1e4f-45b9-be08-3f23d377675d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1545 microversion: 2.1 time: 0.428324 Aug 31 11:44:35.896123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 162/321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:35 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1545 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:35.918933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b844e348-d118-4e69-96bd-ab016483df8d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:35.919604 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b844e348-d118-4e69-96bd-ab016483df8d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:35.927108 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b844e348-d118-4e69-96bd-ab016483df8d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:35.928379 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b844e348-d118-4e69-96bd-ab016483df8d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:35.929071 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b844e348-d118-4e69-96bd-ab016483df8d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:35.929869 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b844e348-d118-4e69-96bd-ab016483df8d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:35.930523 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b844e348-d118-4e69-96bd-ab016483df8d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:35.931308 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b844e348-d118-4e69-96bd-ab016483df8d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:36.059925 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b844e348-d118-4e69-96bd-ab016483df8d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146241 Aug 31 11:44:36.060540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 160/322] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 31 11:44:35 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:44:36.483006 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-faaaa1ec-6d59-4259-b4c4-2c0185947c7c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:36.484376 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-faaaa1ec-6d59-4259-b4c4-2c0185947c7c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:36.506809 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-f9cc0621-470d-4291-a377-273dc4604e17 req-6f3a45f2-0ffd-46a5-9b7b-bd64910215f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece59cd5-8579-4406-be68-9d0204aeb446", "tag": "df889158-674c-400a-bd63-cbcff640456f"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:44:36.523073 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-faaaa1ec-6d59-4259-b4c4-2c0185947c7c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:36.523801 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-faaaa1ec-6d59-4259-b4c4-2c0185947c7c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:36.524433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-faaaa1ec-6d59-4259-b4c4-2c0185947c7c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:36.525498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-faaaa1ec-6d59-4259-b4c4-2c0185947c7c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:36.526254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-faaaa1ec-6d59-4259-b4c4-2c0185947c7c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:36.526846 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-faaaa1ec-6d59-4259-b4c4-2c0185947c7c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:36.578928 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-f9cc0621-470d-4291-a377-273dc4604e17 req-6f3a45f2-0ffd-46a5-9b7b-bd64910215f1 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:36.579832 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-f9cc0621-470d-4291-a377-273dc4604e17 req-6f3a45f2-0ffd-46a5-9b7b-bd64910215f1 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:36.580948 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-f9cc0621-470d-4291-a377-273dc4604e17 req-6f3a45f2-0ffd-46a5-9b7b-bd64910215f1 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:36.615460 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-f9cc0621-470d-4291-a377-273dc4604e17 req-6f3a45f2-0ffd-46a5-9b7b-bd64910215f1 service nova] Creating event network-changed:df889158-674c-400a-bd63-cbcff640456f for instance ece59cd5-8579-4406-be68-9d0204aeb446 on hv-cinder-83976 Aug 31 11:44:36.628791 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-f9cc0621-470d-4291-a377-273dc4604e17 req-6f3a45f2-0ffd-46a5-9b7b-bd64910215f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135946 Aug 31 11:44:36.630812 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 161/323] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:44:36.637638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-d227de37-46da-402b-b8c2-bdaecdffb022 req-f97302dd-9b4e-4a31-aee0-0a13b274121d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06215e54-27bb-4685-9a34-14109d73c81e", "tag": "c4e2bf04-c687-4686-9210-e0be89d06923"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:44:36.651386 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-d227de37-46da-402b-b8c2-bdaecdffb022 req-f97302dd-9b4e-4a31-aee0-0a13b274121d service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:36.652198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-d227de37-46da-402b-b8c2-bdaecdffb022 req-f97302dd-9b4e-4a31-aee0-0a13b274121d service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:36.653213 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-d227de37-46da-402b-b8c2-bdaecdffb022 req-f97302dd-9b4e-4a31-aee0-0a13b274121d service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:36.670616 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-d227de37-46da-402b-b8c2-bdaecdffb022 req-f97302dd-9b4e-4a31-aee0-0a13b274121d service nova] Creating event network-changed:c4e2bf04-c687-4686-9210-e0be89d06923 for instance 06215e54-27bb-4685-9a34-14109d73c81e on hv-cinder-83976 Aug 31 11:44:36.679078 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-d227de37-46da-402b-b8c2-bdaecdffb022 req-f97302dd-9b4e-4a31-aee0-0a13b274121d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046228 Aug 31 11:44:36.680005 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 162/324] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:44:36.729622 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a2fb3506-7a29-4ca2-b324-390b1142f16a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:36.731288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a2fb3506-7a29-4ca2-b324-390b1142f16a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:36.740666 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a2fb3506-7a29-4ca2-b324-390b1142f16a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:36.741916 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a2fb3506-7a29-4ca2-b324-390b1142f16a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:36.742368 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a2fb3506-7a29-4ca2-b324-390b1142f16a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:36.743078 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a2fb3506-7a29-4ca2-b324-390b1142f16a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:36.743533 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a2fb3506-7a29-4ca2-b324-390b1142f16a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:36.743957 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a2fb3506-7a29-4ca2-b324-390b1142f16a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:36.926713 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a2fb3506-7a29-4ca2-b324-390b1142f16a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:36.937533 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a2fb3506-7a29-4ca2-b324-390b1142f16a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1501 microversion: 2.1 time: 0.225188 Aug 31 11:44:36.955194 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 163/325] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:36 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1501 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:37.056270 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-faaaa1ec-6d59-4259-b4c4-2c0185947c7c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:37.067386 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-faaaa1ec-6d59-4259-b4c4-2c0185947c7c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.600777 Aug 31 11:44:37.068540 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 163/326] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:36 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:38.090986 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4f901e87-a100-4ec0-997d-70346d9a7ca9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:38.091664 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4f901e87-a100-4ec0-997d-70346d9a7ca9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:38.098573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f901e87-a100-4ec0-997d-70346d9a7ca9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:38.099241 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f901e87-a100-4ec0-997d-70346d9a7ca9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:38.099828 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f901e87-a100-4ec0-997d-70346d9a7ca9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:38.100856 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f901e87-a100-4ec0-997d-70346d9a7ca9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:38.101603 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f901e87-a100-4ec0-997d-70346d9a7ca9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:38.102176 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4f901e87-a100-4ec0-997d-70346d9a7ca9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:38.256481 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4f901e87-a100-4ec0-997d-70346d9a7ca9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:38.265478 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4f901e87-a100-4ec0-997d-70346d9a7ca9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.180212 Aug 31 11:44:38.266060 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 164/327] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:38 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:38.684920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-75f08b20-5d8f-495c-adc8-7b6ed8be3291 req-cbc13c44-e8b8-4472-9eb6-70103ecd756b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cfd5ee-9585-4f45-b34a-b0e87ae35723", "tag": "06958dff-75ee-4641-9552-3e8769a2f96e"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:44:38.695609 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-75f08b20-5d8f-495c-adc8-7b6ed8be3291 req-cbc13c44-e8b8-4472-9eb6-70103ecd756b service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:38.696086 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-75f08b20-5d8f-495c-adc8-7b6ed8be3291 req-cbc13c44-e8b8-4472-9eb6-70103ecd756b service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:38.696523 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-75f08b20-5d8f-495c-adc8-7b6ed8be3291 req-cbc13c44-e8b8-4472-9eb6-70103ecd756b service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:38.708855 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-75f08b20-5d8f-495c-adc8-7b6ed8be3291 req-cbc13c44-e8b8-4472-9eb6-70103ecd756b service nova] Creating event network-changed:06958dff-75ee-4641-9552-3e8769a2f96e for instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 on hv-cinder-83976 Aug 31 11:44:38.714076 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-75f08b20-5d8f-495c-adc8-7b6ed8be3291 req-cbc13c44-e8b8-4472-9eb6-70103ecd756b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032587 Aug 31 11:44:38.714839 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 164/328] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:44:39.286603 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-750fd8b5-51e8-4857-8c62-b98db26111a3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:39.287208 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-750fd8b5-51e8-4857-8c62-b98db26111a3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:39.293242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-750fd8b5-51e8-4857-8c62-b98db26111a3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:39.293728 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-750fd8b5-51e8-4857-8c62-b98db26111a3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:39.294157 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-750fd8b5-51e8-4857-8c62-b98db26111a3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:39.294850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-750fd8b5-51e8-4857-8c62-b98db26111a3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:39.295299 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-750fd8b5-51e8-4857-8c62-b98db26111a3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:39.295722 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-750fd8b5-51e8-4857-8c62-b98db26111a3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:39.428927 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-750fd8b5-51e8-4857-8c62-b98db26111a3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:39.436605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-750fd8b5-51e8-4857-8c62-b98db26111a3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.154214 Aug 31 11:44:39.437167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 165/329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:39 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:40.458033 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-00e11114-9952-46ac-9724-faeaa434d927 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:40.458727 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-00e11114-9952-46ac-9724-faeaa434d927 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:40.464816 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-00e11114-9952-46ac-9724-faeaa434d927 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:40.465296 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-00e11114-9952-46ac-9724-faeaa434d927 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:40.465733 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-00e11114-9952-46ac-9724-faeaa434d927 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:40.466409 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-00e11114-9952-46ac-9724-faeaa434d927 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:40.466863 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-00e11114-9952-46ac-9724-faeaa434d927 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:40.467286 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-00e11114-9952-46ac-9724-faeaa434d927 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:40.596662 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-00e11114-9952-46ac-9724-faeaa434d927 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:40.604364 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-00e11114-9952-46ac-9724-faeaa434d927 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.150838 Aug 31 11:44:40.605267 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 165/330] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:40 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:41.626180 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5b0e6a2f-e633-428a-8284-7a058ce06459 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:41.627261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5b0e6a2f-e633-428a-8284-7a058ce06459 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:41.633132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5b0e6a2f-e633-428a-8284-7a058ce06459 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:41.633602 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5b0e6a2f-e633-428a-8284-7a058ce06459 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:41.634022 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5b0e6a2f-e633-428a-8284-7a058ce06459 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:41.634694 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5b0e6a2f-e633-428a-8284-7a058ce06459 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:41.635129 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5b0e6a2f-e633-428a-8284-7a058ce06459 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:41.635541 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5b0e6a2f-e633-428a-8284-7a058ce06459 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:41.766583 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5b0e6a2f-e633-428a-8284-7a058ce06459 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:41.770157 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:41.775143 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5b0e6a2f-e633-428a-8284-7a058ce06459 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.152792 Aug 31 11:44:41.775698 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 166/331] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:41 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:42.795590 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f4a6a52c-dd1e-4bd6-893e-2ba0bea902f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:42.796202 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f4a6a52c-dd1e-4bd6-893e-2ba0bea902f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:42.802323 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4a6a52c-dd1e-4bd6-893e-2ba0bea902f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:42.802804 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4a6a52c-dd1e-4bd6-893e-2ba0bea902f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:42.803236 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4a6a52c-dd1e-4bd6-893e-2ba0bea902f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:42.803912 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4a6a52c-dd1e-4bd6-893e-2ba0bea902f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:42.804358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4a6a52c-dd1e-4bd6-893e-2ba0bea902f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:42.804816 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4a6a52c-dd1e-4bd6-893e-2ba0bea902f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:42.823397 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:42.935139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f4a6a52c-dd1e-4bd6-893e-2ba0bea902f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:42.943580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f4a6a52c-dd1e-4bd6-893e-2ba0bea902f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.151761 Aug 31 11:44:42.944140 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 166/332] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:42 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:43.965924 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-636b8270-d04c-4081-b2a5-3f79b878ae38 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:43.966638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-636b8270-d04c-4081-b2a5-3f79b878ae38 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:43.973769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-636b8270-d04c-4081-b2a5-3f79b878ae38 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:43.974253 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-636b8270-d04c-4081-b2a5-3f79b878ae38 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:43.974682 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-636b8270-d04c-4081-b2a5-3f79b878ae38 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:43.975374 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-636b8270-d04c-4081-b2a5-3f79b878ae38 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:43.975825 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-636b8270-d04c-4081-b2a5-3f79b878ae38 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:43.976244 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-636b8270-d04c-4081-b2a5-3f79b878ae38 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:44.115692 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-636b8270-d04c-4081-b2a5-3f79b878ae38 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:44.123473 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-636b8270-d04c-4081-b2a5-3f79b878ae38 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.162302 Aug 31 11:44:44.124032 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 167/333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:43 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:45.146366 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-bb875443-78bf-40af-922a-0f1049c29a6c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:45.146989 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-bb875443-78bf-40af-922a-0f1049c29a6c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:45.155400 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bb875443-78bf-40af-922a-0f1049c29a6c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:45.155885 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bb875443-78bf-40af-922a-0f1049c29a6c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:45.156314 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bb875443-78bf-40af-922a-0f1049c29a6c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:45.157033 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bb875443-78bf-40af-922a-0f1049c29a6c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:45.157533 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bb875443-78bf-40af-922a-0f1049c29a6c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:45.157930 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bb875443-78bf-40af-922a-0f1049c29a6c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:45.475620 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-bb875443-78bf-40af-922a-0f1049c29a6c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:45.489168 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-bb875443-78bf-40af-922a-0f1049c29a6c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.348485 Aug 31 11:44:45.489872 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 167/334] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:45 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:45.820117 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2a052f67-60ca-4fb0-b0f7-085f2465ec30 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc4a190a-e9b9-4b8e-9011-9bff99f07ff0"}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:44:45.822501 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2a052f67-60ca-4fb0-b0f7-085f2465ec30 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:45.828850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2a052f67-60ca-4fb0-b0f7-085f2465ec30 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:45.829234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2a052f67-60ca-4fb0-b0f7-085f2465ec30 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:45.829666 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2a052f67-60ca-4fb0-b0f7-085f2465ec30 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:45.830361 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2a052f67-60ca-4fb0-b0f7-085f2465ec30 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:45.830812 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2a052f67-60ca-4fb0-b0f7-085f2465ec30 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:45.831233 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2a052f67-60ca-4fb0-b0f7-085f2465ec30 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:46.220858 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2a052f67-60ca-4fb0-b0f7-085f2465ec30 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "POST /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404720 Aug 31 11:44:46.221848 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 168/335] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 31 11:44:45 2022] POST /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:44:46.511806 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-72b970ba-819b-401e-a834-cdb85d213b87 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:46.512422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-72b970ba-819b-401e-a834-cdb85d213b87 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:46.514373 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=93 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:46.519530 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72b970ba-819b-401e-a834-cdb85d213b87 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:46.520676 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72b970ba-819b-401e-a834-cdb85d213b87 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:46.521307 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72b970ba-819b-401e-a834-cdb85d213b87 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:46.522194 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72b970ba-819b-401e-a834-cdb85d213b87 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:46.522650 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72b970ba-819b-401e-a834-cdb85d213b87 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:46.523252 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72b970ba-819b-401e-a834-cdb85d213b87 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:46.993666 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-72b970ba-819b-401e-a834-cdb85d213b87 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:47.001232 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-72b970ba-819b-401e-a834-cdb85d213b87 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.493469 Aug 31 11:44:47.001787 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 168/336] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:46 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:48.023790 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1df114f4-ffcc-4b22-acd7-40c384ea9550 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:48.024514 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1df114f4-ffcc-4b22-acd7-40c384ea9550 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:48.030803 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1df114f4-ffcc-4b22-acd7-40c384ea9550 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:48.031291 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1df114f4-ffcc-4b22-acd7-40c384ea9550 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:48.031805 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1df114f4-ffcc-4b22-acd7-40c384ea9550 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:48.032516 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1df114f4-ffcc-4b22-acd7-40c384ea9550 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:48.032970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1df114f4-ffcc-4b22-acd7-40c384ea9550 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:48.033396 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1df114f4-ffcc-4b22-acd7-40c384ea9550 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:48.173405 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1df114f4-ffcc-4b22-acd7-40c384ea9550 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:48.182622 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1df114f4-ffcc-4b22-acd7-40c384ea9550 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.164445 Aug 31 11:44:48.183318 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 169/337] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:48 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:49.203986 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-51b70026-657e-4fea-a42a-d8e0e694359c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:49.204778 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-51b70026-657e-4fea-a42a-d8e0e694359c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:49.211939 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-51b70026-657e-4fea-a42a-d8e0e694359c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:49.212127 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-51b70026-657e-4fea-a42a-d8e0e694359c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:49.212580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-51b70026-657e-4fea-a42a-d8e0e694359c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:49.213313 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-51b70026-657e-4fea-a42a-d8e0e694359c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:49.213791 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-51b70026-657e-4fea-a42a-d8e0e694359c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:49.214236 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-51b70026-657e-4fea-a42a-d8e0e694359c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:49.355703 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-51b70026-657e-4fea-a42a-d8e0e694359c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:49.363720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-51b70026-657e-4fea-a42a-d8e0e694359c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.163485 Aug 31 11:44:49.364284 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 169/338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:49 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:50.384817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c79c63fa-6011-4d44-aa1e-373dcd910fb8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:50.385420 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c79c63fa-6011-4d44-aa1e-373dcd910fb8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:50.387958 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=91 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:44:50.392782 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c79c63fa-6011-4d44-aa1e-373dcd910fb8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:50.393261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c79c63fa-6011-4d44-aa1e-373dcd910fb8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:50.393689 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c79c63fa-6011-4d44-aa1e-373dcd910fb8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:50.394442 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c79c63fa-6011-4d44-aa1e-373dcd910fb8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:50.395494 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c79c63fa-6011-4d44-aa1e-373dcd910fb8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:50.395913 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c79c63fa-6011-4d44-aa1e-373dcd910fb8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:50.666320 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c79c63fa-6011-4d44-aa1e-373dcd910fb8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:50.674933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c79c63fa-6011-4d44-aa1e-373dcd910fb8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.294047 Aug 31 11:44:50.675486 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 170/339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:50 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:51.695460 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0c8e5e3d-1dfa-4098-b94e-a1d7ce2a68e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:51.696058 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0c8e5e3d-1dfa-4098-b94e-a1d7ce2a68e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:51.702068 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c8e5e3d-1dfa-4098-b94e-a1d7ce2a68e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:51.702841 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c8e5e3d-1dfa-4098-b94e-a1d7ce2a68e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:51.703056 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c8e5e3d-1dfa-4098-b94e-a1d7ce2a68e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:51.703784 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c8e5e3d-1dfa-4098-b94e-a1d7ce2a68e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:51.704732 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c8e5e3d-1dfa-4098-b94e-a1d7ce2a68e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:51.705163 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0c8e5e3d-1dfa-4098-b94e-a1d7ce2a68e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:51.867254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0c8e5e3d-1dfa-4098-b94e-a1d7ce2a68e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:51.874828 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0c8e5e3d-1dfa-4098-b94e-a1d7ce2a68e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.183366 Aug 31 11:44:51.888686 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 170/340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:51 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:52.898438 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fd2cfcbb-c380-4310-8255-bb1dad1579db tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:52.899363 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fd2cfcbb-c380-4310-8255-bb1dad1579db tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:52.906777 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fd2cfcbb-c380-4310-8255-bb1dad1579db tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:52.907257 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fd2cfcbb-c380-4310-8255-bb1dad1579db tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:52.907687 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fd2cfcbb-c380-4310-8255-bb1dad1579db tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:52.908380 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fd2cfcbb-c380-4310-8255-bb1dad1579db tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:52.908859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fd2cfcbb-c380-4310-8255-bb1dad1579db tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:52.909282 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fd2cfcbb-c380-4310-8255-bb1dad1579db tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:53.051046 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-fd2cfcbb-c380-4310-8255-bb1dad1579db tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:53.058672 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-fd2cfcbb-c380-4310-8255-bb1dad1579db tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.165858 Aug 31 11:44:53.059221 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 171/341] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:52 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:54.078952 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2647fc80-c2ad-4198-a67b-a9b2af78930e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:54.080135 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2647fc80-c2ad-4198-a67b-a9b2af78930e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:54.086537 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2647fc80-c2ad-4198-a67b-a9b2af78930e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:54.087049 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2647fc80-c2ad-4198-a67b-a9b2af78930e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:54.087466 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2647fc80-c2ad-4198-a67b-a9b2af78930e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:54.088189 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2647fc80-c2ad-4198-a67b-a9b2af78930e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:54.088676 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2647fc80-c2ad-4198-a67b-a9b2af78930e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:54.089360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2647fc80-c2ad-4198-a67b-a9b2af78930e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:54.217511 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2647fc80-c2ad-4198-a67b-a9b2af78930e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:54.225722 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2647fc80-c2ad-4198-a67b-a9b2af78930e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.150491 Aug 31 11:44:54.226701 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 171/342] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:54 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:55.246107 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9dc5f641-51f5-4acd-9981-4391fd950c68 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:55.246710 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9dc5f641-51f5-4acd-9981-4391fd950c68 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:55.253149 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9dc5f641-51f5-4acd-9981-4391fd950c68 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:55.254152 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9dc5f641-51f5-4acd-9981-4391fd950c68 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:55.254658 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9dc5f641-51f5-4acd-9981-4391fd950c68 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:55.255343 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9dc5f641-51f5-4acd-9981-4391fd950c68 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:55.255797 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9dc5f641-51f5-4acd-9981-4391fd950c68 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:55.256222 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9dc5f641-51f5-4acd-9981-4391fd950c68 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:55.381656 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9dc5f641-51f5-4acd-9981-4391fd950c68 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:55.389265 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9dc5f641-51f5-4acd-9981-4391fd950c68 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.147030 Aug 31 11:44:55.389828 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 172/343] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:55 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:56.411944 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b5f5f8f1-79b0-44e7-bec1-b19099b4ddd9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:56.412585 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b5f5f8f1-79b0-44e7-bec1-b19099b4ddd9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:56.418683 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5f5f8f1-79b0-44e7-bec1-b19099b4ddd9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:56.419169 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5f5f8f1-79b0-44e7-bec1-b19099b4ddd9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:56.419605 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5f5f8f1-79b0-44e7-bec1-b19099b4ddd9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:56.420294 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5f5f8f1-79b0-44e7-bec1-b19099b4ddd9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:56.420782 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5f5f8f1-79b0-44e7-bec1-b19099b4ddd9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:56.421213 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5f5f8f1-79b0-44e7-bec1-b19099b4ddd9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:56.563449 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b5f5f8f1-79b0-44e7-bec1-b19099b4ddd9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:56.571507 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b5f5f8f1-79b0-44e7-bec1-b19099b4ddd9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.164209 Aug 31 11:44:56.572117 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 172/344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:56 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:57.096052 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-413841bc-75c3-4cd5-a293-82dd5d6efc3a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:57.096631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-413841bc-75c3-4cd5-a293-82dd5d6efc3a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:57.103679 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-413841bc-75c3-4cd5-a293-82dd5d6efc3a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:57.104153 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-413841bc-75c3-4cd5-a293-82dd5d6efc3a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:57.104610 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-413841bc-75c3-4cd5-a293-82dd5d6efc3a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:57.105290 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-413841bc-75c3-4cd5-a293-82dd5d6efc3a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:57.105738 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-413841bc-75c3-4cd5-a293-82dd5d6efc3a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:57.106158 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-413841bc-75c3-4cd5-a293-82dd5d6efc3a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:57.130935 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-413841bc-75c3-4cd5-a293-82dd5d6efc3a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Going to try to terminate instance {{(pid=127061) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:44:57.212247 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-413841bc-75c3-4cd5-a293-82dd5d6efc3a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 204 len: 0 microversion: 2.1 time: 0.119669 Aug 31 11:44:57.212858 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 173/345] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:44:57 2022] DELETE /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:44:57.220933 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-54798ed5-f604-4fb4-a29b-98d2896e37ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:57.221539 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-54798ed5-f604-4fb4-a29b-98d2896e37ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:57.228840 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-54798ed5-f604-4fb4-a29b-98d2896e37ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:57.229326 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-54798ed5-f604-4fb4-a29b-98d2896e37ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:57.229760 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-54798ed5-f604-4fb4-a29b-98d2896e37ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:57.230450 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-54798ed5-f604-4fb4-a29b-98d2896e37ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:57.230900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-54798ed5-f604-4fb4-a29b-98d2896e37ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:57.231325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-54798ed5-f604-4fb4-a29b-98d2896e37ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:57.360061 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-54798ed5-f604-4fb4-a29b-98d2896e37ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:57.368376 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-54798ed5-f604-4fb4-a29b-98d2896e37ec tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1553 microversion: 2.1 time: 0.151224 Aug 31 11:44:57.368970 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 173/346] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:57 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:57.593279 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c9e3747b-039c-496a-abdf-a343d0e996de tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:57.593795 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c9e3747b-039c-496a-abdf-a343d0e996de tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:57.600583 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c9e3747b-039c-496a-abdf-a343d0e996de tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:57.601197 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c9e3747b-039c-496a-abdf-a343d0e996de tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:57.601761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c9e3747b-039c-496a-abdf-a343d0e996de tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:57.602512 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c9e3747b-039c-496a-abdf-a343d0e996de tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:57.603029 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c9e3747b-039c-496a-abdf-a343d0e996de tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:57.603516 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c9e3747b-039c-496a-abdf-a343d0e996de tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:57.737785 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c9e3747b-039c-496a-abdf-a343d0e996de tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:57.747324 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c9e3747b-039c-496a-abdf-a343d0e996de tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.158429 Aug 31 11:44:57.747892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 174/347] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:57 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:58.389268 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4cc5443d-b1fd-4b3c-b132-2fc8f9768759 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:58.389869 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4cc5443d-b1fd-4b3c-b132-2fc8f9768759 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:58.396934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4cc5443d-b1fd-4b3c-b132-2fc8f9768759 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:58.397420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4cc5443d-b1fd-4b3c-b132-2fc8f9768759 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:58.397854 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4cc5443d-b1fd-4b3c-b132-2fc8f9768759 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:58.398549 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4cc5443d-b1fd-4b3c-b132-2fc8f9768759 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:58.398998 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4cc5443d-b1fd-4b3c-b132-2fc8f9768759 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:58.399422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4cc5443d-b1fd-4b3c-b132-2fc8f9768759 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:58.530306 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4cc5443d-b1fd-4b3c-b132-2fc8f9768759 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:58.538438 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4cc5443d-b1fd-4b3c-b132-2fc8f9768759 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1553 microversion: 2.1 time: 0.152951 Aug 31 11:44:58.538995 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 174/348] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:58 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:58.767232 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-77fb5390-cab1-4e1f-851d-ff08b37e4f5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:58.767759 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-77fb5390-cab1-4e1f-851d-ff08b37e4f5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:58.774373 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-77fb5390-cab1-4e1f-851d-ff08b37e4f5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:58.774847 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-77fb5390-cab1-4e1f-851d-ff08b37e4f5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:58.775276 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-77fb5390-cab1-4e1f-851d-ff08b37e4f5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:58.775956 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-77fb5390-cab1-4e1f-851d-ff08b37e4f5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:58.776399 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-77fb5390-cab1-4e1f-851d-ff08b37e4f5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:58.776845 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-77fb5390-cab1-4e1f-851d-ff08b37e4f5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:58.909764 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-77fb5390-cab1-4e1f-851d-ff08b37e4f5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:58.917683 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-77fb5390-cab1-4e1f-851d-ff08b37e4f5a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.154379 Aug 31 11:44:58.918245 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 175/349] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:58 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:59.559768 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f4d31010-1f60-4641-b3e8-ecdec65b53ea tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:59.560604 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f4d31010-1f60-4641-b3e8-ecdec65b53ea tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:59.567549 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4d31010-1f60-4641-b3e8-ecdec65b53ea tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:59.568093 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4d31010-1f60-4641-b3e8-ecdec65b53ea tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:59.568736 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4d31010-1f60-4641-b3e8-ecdec65b53ea tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:59.569570 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4d31010-1f60-4641-b3e8-ecdec65b53ea tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:59.570087 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4d31010-1f60-4641-b3e8-ecdec65b53ea tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:59.570732 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4d31010-1f60-4641-b3e8-ecdec65b53ea tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:59.712093 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f4d31010-1f60-4641-b3e8-ecdec65b53ea tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:44:59.720384 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f4d31010-1f60-4641-b3e8-ecdec65b53ea tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1553 microversion: 2.1 time: 0.164665 Aug 31 11:44:59.721063 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 175/350] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:59 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:44:59.939390 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ab7aee50-2790-47d7-b62d-722b87ed43f1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:44:59.940205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ab7aee50-2790-47d7-b62d-722b87ed43f1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:44:59.946688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ab7aee50-2790-47d7-b62d-722b87ed43f1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:59.947269 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ab7aee50-2790-47d7-b62d-722b87ed43f1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:59.947766 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ab7aee50-2790-47d7-b62d-722b87ed43f1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:44:59.948622 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ab7aee50-2790-47d7-b62d-722b87ed43f1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:44:59.949138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ab7aee50-2790-47d7-b62d-722b87ed43f1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:44:59.949717 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ab7aee50-2790-47d7-b62d-722b87ed43f1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:00.108722 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ab7aee50-2790-47d7-b62d-722b87ed43f1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:00.118686 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ab7aee50-2790-47d7-b62d-722b87ed43f1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.183170 Aug 31 11:45:00.119720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 176/351] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:44:59 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:00.365970 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-abcb8f3a-b41c-47df-b4be-9cacf93f6790 req-2b56e5af-bfa3-4486-932e-a7eba1d0e2dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee843c31-1261-43ec-8358-d9bdceb3fb26", "name": "network-vif-deleted", "tag": "736b1786-49b6-4725-ae4c-14888fe4a5e3"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:45:00.376182 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-abcb8f3a-b41c-47df-b4be-9cacf93f6790 req-2b56e5af-bfa3-4486-932e-a7eba1d0e2dd service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:00.376747 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-abcb8f3a-b41c-47df-b4be-9cacf93f6790 req-2b56e5af-bfa3-4486-932e-a7eba1d0e2dd service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:00.377181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-abcb8f3a-b41c-47df-b4be-9cacf93f6790 req-2b56e5af-bfa3-4486-932e-a7eba1d0e2dd service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:00.398643 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-abcb8f3a-b41c-47df-b4be-9cacf93f6790 req-2b56e5af-bfa3-4486-932e-a7eba1d0e2dd service nova] Creating event network-vif-deleted:736b1786-49b6-4725-ae4c-14888fe4a5e3 for instance ee843c31-1261-43ec-8358-d9bdceb3fb26 on hv-cinder-83976 Aug 31 11:45:00.404231 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-abcb8f3a-b41c-47df-b4be-9cacf93f6790 req-2b56e5af-bfa3-4486-932e-a7eba1d0e2dd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042736 Aug 31 11:45:00.405029 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 176/352] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:45:00.741876 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f70202cf-2202-497e-a359-0140eeddddf6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:00.742483 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f70202cf-2202-497e-a359-0140eeddddf6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:00.748510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f70202cf-2202-497e-a359-0140eeddddf6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:00.748995 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f70202cf-2202-497e-a359-0140eeddddf6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:00.749423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f70202cf-2202-497e-a359-0140eeddddf6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:00.750110 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f70202cf-2202-497e-a359-0140eeddddf6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:00.750558 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f70202cf-2202-497e-a359-0140eeddddf6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:00.750979 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f70202cf-2202-497e-a359-0140eeddddf6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:00.813260 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f70202cf-2202-497e-a359-0140eeddddf6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:00.822963 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f70202cf-2202-497e-a359-0140eeddddf6 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1345 microversion: 2.1 time: 0.085442 Aug 31 11:45:00.823535 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 177/353] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:00 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:01.139668 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3338860c-f904-4258-80bd-e0dba8bc01c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:01.140455 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3338860c-f904-4258-80bd-e0dba8bc01c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:01.147386 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3338860c-f904-4258-80bd-e0dba8bc01c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:01.147942 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3338860c-f904-4258-80bd-e0dba8bc01c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:01.148392 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3338860c-f904-4258-80bd-e0dba8bc01c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:01.149313 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3338860c-f904-4258-80bd-e0dba8bc01c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:01.149763 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3338860c-f904-4258-80bd-e0dba8bc01c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:01.150184 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3338860c-f904-4258-80bd-e0dba8bc01c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:01.311283 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3338860c-f904-4258-80bd-e0dba8bc01c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:01.321298 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3338860c-f904-4258-80bd-e0dba8bc01c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.185776 Aug 31 11:45:01.321911 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 177/354] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:01 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:01.843215 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d9d26d43-2a43-4682-bffa-9fa02f58381a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:01.843816 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d9d26d43-2a43-4682-bffa-9fa02f58381a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:01.850786 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d9d26d43-2a43-4682-bffa-9fa02f58381a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:01.851265 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d9d26d43-2a43-4682-bffa-9fa02f58381a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:01.851692 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d9d26d43-2a43-4682-bffa-9fa02f58381a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:01.852373 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d9d26d43-2a43-4682-bffa-9fa02f58381a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:01.852853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d9d26d43-2a43-4682-bffa-9fa02f58381a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:01.853271 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d9d26d43-2a43-4682-bffa-9fa02f58381a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:01.882802 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d9d26d43-2a43-4682-bffa-9fa02f58381a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:01.883270 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d9d26d43-2a43-4682-bffa-9fa02f58381a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:01.883698 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d9d26d43-2a43-4682-bffa-9fa02f58381a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:01.884132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-d9d26d43-2a43-4682-bffa-9fa02f58381a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lazy-loading 'fault' on Instance uuid ee843c31-1261-43ec-8358-d9bdceb3fb26 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:45:01.930082 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d9d26d43-2a43-4682-bffa-9fa02f58381a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:01.938127 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d9d26d43-2a43-4682-bffa-9fa02f58381a tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1350 microversion: 2.1 time: 0.098882 Aug 31 11:45:01.938692 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 178/355] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:01 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:02.343216 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-07609419-19d7-4f5c-b7d4-a23ffeaf5e2a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:02.343764 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-07609419-19d7-4f5c-b7d4-a23ffeaf5e2a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:02.350141 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-07609419-19d7-4f5c-b7d4-a23ffeaf5e2a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:02.350622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-07609419-19d7-4f5c-b7d4-a23ffeaf5e2a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:02.351053 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-07609419-19d7-4f5c-b7d4-a23ffeaf5e2a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:02.351729 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-07609419-19d7-4f5c-b7d4-a23ffeaf5e2a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:02.352178 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-07609419-19d7-4f5c-b7d4-a23ffeaf5e2a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:02.352697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-07609419-19d7-4f5c-b7d4-a23ffeaf5e2a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:02.477333 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-07609419-19d7-4f5c-b7d4-a23ffeaf5e2a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:02.484831 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-07609419-19d7-4f5c-b7d4-a23ffeaf5e2a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.145538 Aug 31 11:45:02.485386 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 178/356] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:02 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:02.960171 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3cfcc0ec-e77c-471e-8fef-142249d50b43 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:02.960860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3cfcc0ec-e77c-471e-8fef-142249d50b43 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:02.966985 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3cfcc0ec-e77c-471e-8fef-142249d50b43 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:02.967457 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3cfcc0ec-e77c-471e-8fef-142249d50b43 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:02.967886 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3cfcc0ec-e77c-471e-8fef-142249d50b43 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:02.968589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3cfcc0ec-e77c-471e-8fef-142249d50b43 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:02.969041 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3cfcc0ec-e77c-471e-8fef-142249d50b43 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:02.969458 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3cfcc0ec-e77c-471e-8fef-142249d50b43 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:02.998941 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3cfcc0ec-e77c-471e-8fef-142249d50b43 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:02.999405 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3cfcc0ec-e77c-471e-8fef-142249d50b43 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:02.999834 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3cfcc0ec-e77c-471e-8fef-142249d50b43 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:03.000264 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-3cfcc0ec-e77c-471e-8fef-142249d50b43 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lazy-loading 'fault' on Instance uuid ee843c31-1261-43ec-8358-d9bdceb3fb26 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:45:03.040367 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3cfcc0ec-e77c-471e-8fef-142249d50b43 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:03.043779 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:45:03.049712 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3cfcc0ec-e77c-471e-8fef-142249d50b43 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1350 microversion: 2.1 time: 0.094229 Aug 31 11:45:03.051198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 179/357] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:02 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:03.505780 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-24e4472d-e56e-4bab-a442-8ddc7f881817 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:03.506382 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-24e4472d-e56e-4bab-a442-8ddc7f881817 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:03.512243 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-24e4472d-e56e-4bab-a442-8ddc7f881817 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:03.512754 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-24e4472d-e56e-4bab-a442-8ddc7f881817 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:03.513186 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-24e4472d-e56e-4bab-a442-8ddc7f881817 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:03.513860 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-24e4472d-e56e-4bab-a442-8ddc7f881817 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:03.514306 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-24e4472d-e56e-4bab-a442-8ddc7f881817 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:03.514725 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-24e4472d-e56e-4bab-a442-8ddc7f881817 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:03.642593 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-24e4472d-e56e-4bab-a442-8ddc7f881817 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:03.650457 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-24e4472d-e56e-4bab-a442-8ddc7f881817 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.148982 Aug 31 11:45:03.651086 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 179/358] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:03 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:04.071484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4ed86ed0-e6fb-427c-bb02-43d4a2dd234f tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:04.072109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4ed86ed0-e6fb-427c-bb02-43d4a2dd234f tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:04.079267 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4ed86ed0-e6fb-427c-bb02-43d4a2dd234f tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:04.079743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4ed86ed0-e6fb-427c-bb02-43d4a2dd234f tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:04.080167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4ed86ed0-e6fb-427c-bb02-43d4a2dd234f tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:04.080871 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4ed86ed0-e6fb-427c-bb02-43d4a2dd234f tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:04.081308 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4ed86ed0-e6fb-427c-bb02-43d4a2dd234f tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:04.082243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4ed86ed0-e6fb-427c-bb02-43d4a2dd234f tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:04.112507 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4ed86ed0-e6fb-427c-bb02-43d4a2dd234f tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:04.113183 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4ed86ed0-e6fb-427c-bb02-43d4a2dd234f tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:04.113416 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4ed86ed0-e6fb-427c-bb02-43d4a2dd234f tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:04.113840 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-4ed86ed0-e6fb-427c-bb02-43d4a2dd234f tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lazy-loading 'fault' on Instance uuid ee843c31-1261-43ec-8358-d9bdceb3fb26 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:45:04.153150 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4ed86ed0-e6fb-427c-bb02-43d4a2dd234f tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:04.161741 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4ed86ed0-e6fb-427c-bb02-43d4a2dd234f tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1350 microversion: 2.1 time: 0.094489 Aug 31 11:45:04.162311 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 180/359] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:04 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:04.671634 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b05f8af7-f0be-421d-ab43-c2cf4d62a1d6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:04.672366 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b05f8af7-f0be-421d-ab43-c2cf4d62a1d6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:04.679874 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b05f8af7-f0be-421d-ab43-c2cf4d62a1d6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:04.680755 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b05f8af7-f0be-421d-ab43-c2cf4d62a1d6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:04.681353 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b05f8af7-f0be-421d-ab43-c2cf4d62a1d6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:04.682565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b05f8af7-f0be-421d-ab43-c2cf4d62a1d6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:04.683165 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b05f8af7-f0be-421d-ab43-c2cf4d62a1d6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:04.683735 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b05f8af7-f0be-421d-ab43-c2cf4d62a1d6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:04.812621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b05f8af7-f0be-421d-ab43-c2cf4d62a1d6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:04.820544 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b05f8af7-f0be-421d-ab43-c2cf4d62a1d6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.152963 Aug 31 11:45:04.821104 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 180/360] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:04 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:05.182453 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c222cdf7-b008-4d3f-8209-b72e18d59423 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:05.183055 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c222cdf7-b008-4d3f-8209-b72e18d59423 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:05.189418 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c222cdf7-b008-4d3f-8209-b72e18d59423 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:05.189892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c222cdf7-b008-4d3f-8209-b72e18d59423 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:05.190327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c222cdf7-b008-4d3f-8209-b72e18d59423 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:05.191257 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c222cdf7-b008-4d3f-8209-b72e18d59423 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:05.191882 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c222cdf7-b008-4d3f-8209-b72e18d59423 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:05.192276 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c222cdf7-b008-4d3f-8209-b72e18d59423 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:05.224476 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c222cdf7-b008-4d3f-8209-b72e18d59423 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:05.224971 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c222cdf7-b008-4d3f-8209-b72e18d59423 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:05.225403 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c222cdf7-b008-4d3f-8209-b72e18d59423 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:05.225900 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-c222cdf7-b008-4d3f-8209-b72e18d59423 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lazy-loading 'fault' on Instance uuid ee843c31-1261-43ec-8358-d9bdceb3fb26 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:45:05.278270 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c222cdf7-b008-4d3f-8209-b72e18d59423 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d27f92c992749cfa5502babb56cb5a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a0149745754ac59b97e489312dd3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:05.287024 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c222cdf7-b008-4d3f-8209-b72e18d59423 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 200 len: 1350 microversion: 2.1 time: 0.108402 Aug 31 11:45:05.287577 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 181/361] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:05 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 1350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:05.841043 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-79c481ce-dd2d-4f9d-a9da-f26cddd374ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:05.841651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-79c481ce-dd2d-4f9d-a9da-f26cddd374ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:05.848122 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-79c481ce-dd2d-4f9d-a9da-f26cddd374ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:05.848631 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-79c481ce-dd2d-4f9d-a9da-f26cddd374ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:05.849063 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-79c481ce-dd2d-4f9d-a9da-f26cddd374ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:05.849751 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-79c481ce-dd2d-4f9d-a9da-f26cddd374ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:05.850201 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-79c481ce-dd2d-4f9d-a9da-f26cddd374ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:05.850625 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-79c481ce-dd2d-4f9d-a9da-f26cddd374ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:05.983583 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-79c481ce-dd2d-4f9d-a9da-f26cddd374ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:05.992512 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-79c481ce-dd2d-4f9d-a9da-f26cddd374ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.155307 Aug 31 11:45:05.993423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 181/362] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:05 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:06.307584 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-109e7d7a-b5e3-428e-8e41-61d67d4bb00d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:06.308188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-109e7d7a-b5e3-428e-8e41-61d67d4bb00d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:06.314798 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-109e7d7a-b5e3-428e-8e41-61d67d4bb00d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:06.315165 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-109e7d7a-b5e3-428e-8e41-61d67d4bb00d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:06.317475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-109e7d7a-b5e3-428e-8e41-61d67d4bb00d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:06.318195 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-109e7d7a-b5e3-428e-8e41-61d67d4bb00d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:06.318657 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-109e7d7a-b5e3-428e-8e41-61d67d4bb00d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:06.319084 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-109e7d7a-b5e3-428e-8e41-61d67d4bb00d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:06.333530 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-109e7d7a-b5e3-428e-8e41-61d67d4bb00d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] HTTP exception thrown: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-109e7d7a-b5e3-428e-8e41-61d67d4bb00d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Request method failure captured: Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 HTTP/1.1 Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lRKLWdAuao4NcKBWvi4WNfpDHq3CkDfyOR0GgiU4ayUrb0fQbPIxFDRRj1d33PmtRjQyCeYvbGcxgPxvWyj2QD9hVzIpzoSzVFFn4iNGa3EjODf-f2r5prfaJp41LgWBkj8d7bOK0tN37A2jApC2oxAqAZ6CqDegaZXKtLpkBbyZY Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: 11a0149745754ac59b97e489312dd3ab Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-DeleteServersTestJSON-807638154 Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:45:06.338972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:45:06.340477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_11a0149745754ac59b97e489312dd3ab", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/11a0149745754ac59b97e489312dd3ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11a0149745754ac59b97e489312dd3ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11a0149745754ac59b97e489312dd3ab"}]}] Aug 31 11:45:06.340477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-DeleteServersTestJSON-807638154 Aug 31 11:45:06.340477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: 11a0149745754ac59b97e489312dd3ab Aug 31 11:45:06.340477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-DeleteServersTestJSON-807638154 Aug 31 11:45:06.340477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-DeleteServersTestJSON-807638154-project Aug 31 11:45:06.340477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:45:06.340477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:45:06.340477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 0d27f92c992749cfa5502babb56cb5a4 Aug 31 11:45:06.340477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-DeleteServersTestJSON-807638154-project Aug 31 11:45:06.340477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:45:06.340477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:06.340477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': 'ee843c31-1261-43ec-8358-d9bdceb3fb26'} Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:45:06.341316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:06.342605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:45:06.343786 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-109e7d7a-b5e3-428e-8e41-61d67d4bb00d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Returning 404 to user: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:45:06.343786 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-109e7d7a-b5e3-428e-8e41-61d67d4bb00d tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 404 len: 111 microversion: 2.1 time: 0.036698 Aug 31 11:45:06.343786 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 182/363] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:06 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:45:06.449143 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5871124a-2d35-443a-96ca-4b41a0299584 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:06.451345 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5871124a-2d35-443a-96ca-4b41a0299584 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:06.457613 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5871124a-2d35-443a-96ca-4b41a0299584 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:06.458101 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5871124a-2d35-443a-96ca-4b41a0299584 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:06.458536 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5871124a-2d35-443a-96ca-4b41a0299584 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:06.459223 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5871124a-2d35-443a-96ca-4b41a0299584 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:06.459672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5871124a-2d35-443a-96ca-4b41a0299584 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:06.460098 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5871124a-2d35-443a-96ca-4b41a0299584 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:06.505711 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-5871124a-2d35-443a-96ca-4b41a0299584 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] HTTP exception thrown: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5871124a-2d35-443a-96ca-4b41a0299584 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Request method failure captured: Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26/os-volume_attachments HTTP/1.1 Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lRKLWdAuao4NcKBWvi4WNfpDHq3CkDfyOR0GgiU4ayUrb0fQbPIxFDRRj1d33PmtRjQyCeYvbGcxgPxvWyj2QD9hVzIpzoSzVFFn4iNGa3EjODf-f2r5prfaJp41LgWBkj8d7bOK0tN37A2jApC2oxAqAZ6CqDegaZXKtLpkBbyZY Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 11a0149745754ac59b97e489312dd3ab Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-DeleteServersTestJSON-807638154 Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:45:06.510627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:45:06.512108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_11a0149745754ac59b97e489312dd3ab", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/11a0149745754ac59b97e489312dd3ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11a0149745754ac59b97e489312dd3ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11a0149745754ac59b97e489312dd3ab"}]}] Aug 31 11:45:06.512108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-DeleteServersTestJSON-807638154 Aug 31 11:45:06.512108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 11a0149745754ac59b97e489312dd3ab Aug 31 11:45:06.512108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-DeleteServersTestJSON-807638154 Aug 31 11:45:06.512108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-DeleteServersTestJSON-807638154-project Aug 31 11:45:06.512108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:45:06.512108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:45:06.512108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 0d27f92c992749cfa5502babb56cb5a4 Aug 31 11:45:06.512108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-DeleteServersTestJSON-807638154-project Aug 31 11:45:06.512108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:45:06.512108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:06.512108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'server_id': 'ee843c31-1261-43ec-8358-d9bdceb3fb26'} Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:45:06.512920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:06.514092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:45:06.515426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5871124a-2d35-443a-96ca-4b41a0299584 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Returning 404 to user: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:45:06.515426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5871124a-2d35-443a-96ca-4b41a0299584 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.066916 Aug 31 11:45:06.515426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 182/364] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:45:06 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26/os-volume_attachments => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:45:07.014543 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-319a5978-1c65-4a93-ba3c-1121f4af215e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:07.015164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-319a5978-1c65-4a93-ba3c-1121f4af215e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:07.022311 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-319a5978-1c65-4a93-ba3c-1121f4af215e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:07.022794 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-319a5978-1c65-4a93-ba3c-1121f4af215e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:07.023228 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-319a5978-1c65-4a93-ba3c-1121f4af215e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:07.023920 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-319a5978-1c65-4a93-ba3c-1121f4af215e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:07.024388 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-319a5978-1c65-4a93-ba3c-1121f4af215e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:07.024870 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-319a5978-1c65-4a93-ba3c-1121f4af215e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:07.159008 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-319a5978-1c65-4a93-ba3c-1121f4af215e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:07.167396 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-319a5978-1c65-4a93-ba3c-1121f4af215e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.156843 Aug 31 11:45:07.167957 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 183/365] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:07 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:07.724095 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-43a05e39-1b08-43a7-a6ec-0910e667bfb1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:07.724783 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-43a05e39-1b08-43a7-a6ec-0910e667bfb1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:07.731403 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43a05e39-1b08-43a7-a6ec-0910e667bfb1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:07.731883 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43a05e39-1b08-43a7-a6ec-0910e667bfb1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:07.732315 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43a05e39-1b08-43a7-a6ec-0910e667bfb1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:07.733299 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43a05e39-1b08-43a7-a6ec-0910e667bfb1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:07.733752 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43a05e39-1b08-43a7-a6ec-0910e667bfb1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:07.734174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-43a05e39-1b08-43a7-a6ec-0910e667bfb1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:07.746980 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-43a05e39-1b08-43a7-a6ec-0910e667bfb1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] HTTP exception thrown: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-43a05e39-1b08-43a7-a6ec-0910e667bfb1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Request method failure captured: Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: DELETE /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 HTTP/1.1 Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lRKLWdAuao4NcKBWvi4WNfpDHq3CkDfyOR0GgiU4ayUrb0fQbPIxFDRRj1d33PmtRjQyCeYvbGcxgPxvWyj2QD9hVzIpzoSzVFFn4iNGa3EjODf-f2r5prfaJp41LgWBkj8d7bOK0tN37A2jApC2oxAqAZ6CqDegaZXKtLpkBbyZY Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 11a0149745754ac59b97e489312dd3ab Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-DeleteServersTestJSON-807638154 Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:45:07.749130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:45:07.750498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_11a0149745754ac59b97e489312dd3ab", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/11a0149745754ac59b97e489312dd3ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11a0149745754ac59b97e489312dd3ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11a0149745754ac59b97e489312dd3ab"}]}] Aug 31 11:45:07.750498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-DeleteServersTestJSON-807638154 Aug 31 11:45:07.750498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 11a0149745754ac59b97e489312dd3ab Aug 31 11:45:07.750498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-DeleteServersTestJSON-807638154 Aug 31 11:45:07.750498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-DeleteServersTestJSON-807638154-project Aug 31 11:45:07.750498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:45:07.750498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:45:07.750498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 0d27f92c992749cfa5502babb56cb5a4 Aug 31 11:45:07.750498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-DeleteServersTestJSON-807638154-project Aug 31 11:45:07.750498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:45:07.750498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:07.750498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': 'ee843c31-1261-43ec-8358-d9bdceb3fb26'} Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:45:07.751341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:07.752741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:45:07.754394 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-43a05e39-1b08-43a7-a6ec-0910e667bfb1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Returning 404 to user: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:45:07.754394 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-43a05e39-1b08-43a7-a6ec-0910e667bfb1 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 404 len: 111 microversion: 2.1 time: 0.031084 Aug 31 11:45:07.754394 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 183/366] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:45:07 2022] DELETE /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:45:07.759268 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3376acbb-20ee-44be-99b7-379c20840c74 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:07.759872 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3376acbb-20ee-44be-99b7-379c20840c74 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] [instance: ee843c31-1261-43ec-8358-d9bdceb3fb26] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:07.766281 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3376acbb-20ee-44be-99b7-379c20840c74 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:07.766756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3376acbb-20ee-44be-99b7-379c20840c74 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:07.767185 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3376acbb-20ee-44be-99b7-379c20840c74 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:07.767866 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3376acbb-20ee-44be-99b7-379c20840c74 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:07.768313 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3376acbb-20ee-44be-99b7-379c20840c74 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:07.768765 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3376acbb-20ee-44be-99b7-379c20840c74 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:07.782330 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-3376acbb-20ee-44be-99b7-379c20840c74 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] HTTP exception thrown: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3376acbb-20ee-44be-99b7-379c20840c74 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Request method failure captured: Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 HTTP/1.1 Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lRKLWdAuao4NcKBWvi4WNfpDHq3CkDfyOR0GgiU4ayUrb0fQbPIxFDRRj1d33PmtRjQyCeYvbGcxgPxvWyj2QD9hVzIpzoSzVFFn4iNGa3EjODf-f2r5prfaJp41LgWBkj8d7bOK0tN37A2jApC2oxAqAZ6CqDegaZXKtLpkBbyZY Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: 11a0149745754ac59b97e489312dd3ab Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-DeleteServersTestJSON-807638154 Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:45:07.783859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:45:07.785760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_11a0149745754ac59b97e489312dd3ab", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/11a0149745754ac59b97e489312dd3ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11a0149745754ac59b97e489312dd3ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/11a0149745754ac59b97e489312dd3ab"}]}] Aug 31 11:45:07.785760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-DeleteServersTestJSON-807638154 Aug 31 11:45:07.785760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: 11a0149745754ac59b97e489312dd3ab Aug 31 11:45:07.785760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-DeleteServersTestJSON-807638154 Aug 31 11:45:07.785760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-DeleteServersTestJSON-807638154-project Aug 31 11:45:07.785760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:45:07.785760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:45:07.785760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 0d27f92c992749cfa5502babb56cb5a4 Aug 31 11:45:07.785760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-DeleteServersTestJSON-807638154-project Aug 31 11:45:07.785760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:45:07.785760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:07.785760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': 'ee843c31-1261-43ec-8358-d9bdceb3fb26'} Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:45:07.786422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. Aug 31 11:45:07.787490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:45:07.788481 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3376acbb-20ee-44be-99b7-379c20840c74 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] Returning 404 to user: Instance ee843c31-1261-43ec-8358-d9bdceb3fb26 could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:45:07.788481 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3376acbb-20ee-44be-99b7-379c20840c74 tempest-DeleteServersTestJSON-807638154 tempest-DeleteServersTestJSON-807638154-project] 10.222.0.60 "GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26" status: 404 len: 111 microversion: 2.1 time: 0.030484 Aug 31 11:45:07.788481 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 184/367] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:07 2022] GET /compute/v2.1/servers/ee843c31-1261-43ec-8358-d9bdceb3fb26 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:45:08.189099 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1c931072-780e-470f-b491-e90195a85ef8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:08.189803 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1c931072-780e-470f-b491-e90195a85ef8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:08.196742 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1c931072-780e-470f-b491-e90195a85ef8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:08.197233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1c931072-780e-470f-b491-e90195a85ef8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:08.197930 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1c931072-780e-470f-b491-e90195a85ef8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:08.198744 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1c931072-780e-470f-b491-e90195a85ef8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:08.199198 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1c931072-780e-470f-b491-e90195a85ef8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:08.199622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1c931072-780e-470f-b491-e90195a85ef8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:08.709148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1c931072-780e-470f-b491-e90195a85ef8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:08.717924 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1c931072-780e-470f-b491-e90195a85ef8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.532829 Aug 31 11:45:08.718652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 184/368] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:08 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:09.740072 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1eef4e26-96f1-4d85-adf3-24ea1742aeaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:09.741750 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1eef4e26-96f1-4d85-adf3-24ea1742aeaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:09.751847 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1eef4e26-96f1-4d85-adf3-24ea1742aeaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:09.752759 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1eef4e26-96f1-4d85-adf3-24ea1742aeaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:09.754493 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1eef4e26-96f1-4d85-adf3-24ea1742aeaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:09.757391 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1eef4e26-96f1-4d85-adf3-24ea1742aeaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:09.758082 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1eef4e26-96f1-4d85-adf3-24ea1742aeaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:09.758679 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1eef4e26-96f1-4d85-adf3-24ea1742aeaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:09.929369 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1eef4e26-96f1-4d85-adf3-24ea1742aeaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:09.942797 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1eef4e26-96f1-4d85-adf3-24ea1742aeaa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.207319 Aug 31 11:45:09.944124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 185/369] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:09 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:10.965551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d06d45d9-d228-40c0-bfd5-7de9b0a6797c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:10.966303 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d06d45d9-d228-40c0-bfd5-7de9b0a6797c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:10.973449 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d06d45d9-d228-40c0-bfd5-7de9b0a6797c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:10.974172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d06d45d9-d228-40c0-bfd5-7de9b0a6797c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:10.974817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d06d45d9-d228-40c0-bfd5-7de9b0a6797c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:10.976302 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d06d45d9-d228-40c0-bfd5-7de9b0a6797c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:10.977190 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d06d45d9-d228-40c0-bfd5-7de9b0a6797c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:10.977892 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d06d45d9-d228-40c0-bfd5-7de9b0a6797c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:10.984484 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:45:11.259769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d06d45d9-d228-40c0-bfd5-7de9b0a6797c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:11.275569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d06d45d9-d228-40c0-bfd5-7de9b0a6797c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.314321 Aug 31 11:45:11.293542 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 185/370] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:10 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:12.300389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-79d71980-221d-439f-b813-3077cb46ba24 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:12.301922 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-79d71980-221d-439f-b813-3077cb46ba24 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:12.311300 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-79d71980-221d-439f-b813-3077cb46ba24 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:12.311793 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-79d71980-221d-439f-b813-3077cb46ba24 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:12.312459 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-79d71980-221d-439f-b813-3077cb46ba24 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:12.313439 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-79d71980-221d-439f-b813-3077cb46ba24 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:12.314086 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-79d71980-221d-439f-b813-3077cb46ba24 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:12.314770 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-79d71980-221d-439f-b813-3077cb46ba24 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:12.475259 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-79d71980-221d-439f-b813-3077cb46ba24 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:12.486390 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-79d71980-221d-439f-b813-3077cb46ba24 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.190046 Aug 31 11:45:12.487547 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 186/371] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:12 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:13.515662 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5c94ec7b-2e54-4669-acd2-899e8dd4c5e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:13.516302 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5c94ec7b-2e54-4669-acd2-899e8dd4c5e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:13.528835 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5c94ec7b-2e54-4669-acd2-899e8dd4c5e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:13.529324 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5c94ec7b-2e54-4669-acd2-899e8dd4c5e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:13.532538 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5c94ec7b-2e54-4669-acd2-899e8dd4c5e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:13.533956 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5c94ec7b-2e54-4669-acd2-899e8dd4c5e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:13.535237 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5c94ec7b-2e54-4669-acd2-899e8dd4c5e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:13.535735 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5c94ec7b-2e54-4669-acd2-899e8dd4c5e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:13.793925 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5c94ec7b-2e54-4669-acd2-899e8dd4c5e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:13.805514 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5c94ec7b-2e54-4669-acd2-899e8dd4c5e0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.300285 Aug 31 11:45:13.806195 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 186/372] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:13 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:14.827314 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-20c2a483-4971-451d-bc78-c5d715eaee40 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:14.827951 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-20c2a483-4971-451d-bc78-c5d715eaee40 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:14.837018 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-20c2a483-4971-451d-bc78-c5d715eaee40 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:14.837808 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-20c2a483-4971-451d-bc78-c5d715eaee40 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:14.838245 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-20c2a483-4971-451d-bc78-c5d715eaee40 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:14.838955 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-20c2a483-4971-451d-bc78-c5d715eaee40 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:14.839412 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-20c2a483-4971-451d-bc78-c5d715eaee40 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:14.839838 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-20c2a483-4971-451d-bc78-c5d715eaee40 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:14.989389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-20c2a483-4971-451d-bc78-c5d715eaee40 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:14.999772 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-20c2a483-4971-451d-bc78-c5d715eaee40 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.176449 Aug 31 11:45:15.000642 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 187/373] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:14 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:16.028457 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-678e5db0-6f27-43bf-b9cb-d20852cf1c64 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:16.029097 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-678e5db0-6f27-43bf-b9cb-d20852cf1c64 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:16.035386 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-678e5db0-6f27-43bf-b9cb-d20852cf1c64 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:16.035875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-678e5db0-6f27-43bf-b9cb-d20852cf1c64 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:16.036304 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-678e5db0-6f27-43bf-b9cb-d20852cf1c64 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:16.037014 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-678e5db0-6f27-43bf-b9cb-d20852cf1c64 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:16.037466 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-678e5db0-6f27-43bf-b9cb-d20852cf1c64 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:16.038543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-678e5db0-6f27-43bf-b9cb-d20852cf1c64 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:16.173714 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-678e5db0-6f27-43bf-b9cb-d20852cf1c64 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:16.183272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-678e5db0-6f27-43bf-b9cb-d20852cf1c64 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.158629 Aug 31 11:45:16.183831 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 187/374] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:16 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:17.204934 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9d004303-2295-4373-a66d-a841614cca37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:17.205579 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9d004303-2295-4373-a66d-a841614cca37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:17.211783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9d004303-2295-4373-a66d-a841614cca37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:17.212286 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9d004303-2295-4373-a66d-a841614cca37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:17.212750 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9d004303-2295-4373-a66d-a841614cca37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:17.213425 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9d004303-2295-4373-a66d-a841614cca37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:17.213870 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9d004303-2295-4373-a66d-a841614cca37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:17.214291 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9d004303-2295-4373-a66d-a841614cca37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:17.348316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9d004303-2295-4373-a66d-a841614cca37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:17.356413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9d004303-2295-4373-a66d-a841614cca37 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.155243 Aug 31 11:45:17.357016 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 188/375] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:17 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:18.378040 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e208b568-90f6-4dab-ac2c-2ec22037f2fa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:18.379240 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e208b568-90f6-4dab-ac2c-2ec22037f2fa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:18.381213 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=40 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:45:18.386361 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e208b568-90f6-4dab-ac2c-2ec22037f2fa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:18.386847 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e208b568-90f6-4dab-ac2c-2ec22037f2fa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:18.387280 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e208b568-90f6-4dab-ac2c-2ec22037f2fa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:18.387968 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e208b568-90f6-4dab-ac2c-2ec22037f2fa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:18.388416 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e208b568-90f6-4dab-ac2c-2ec22037f2fa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:18.388861 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e208b568-90f6-4dab-ac2c-2ec22037f2fa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:18.525882 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e208b568-90f6-4dab-ac2c-2ec22037f2fa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:18.536204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e208b568-90f6-4dab-ac2c-2ec22037f2fa tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.162106 Aug 31 11:45:18.536799 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 188/376] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:18 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:19.557133 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-42f13138-f0fa-45d2-a1f4-7be2c965c1a9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:19.557775 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-42f13138-f0fa-45d2-a1f4-7be2c965c1a9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:19.565326 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-42f13138-f0fa-45d2-a1f4-7be2c965c1a9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:19.566818 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-42f13138-f0fa-45d2-a1f4-7be2c965c1a9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:19.567474 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-42f13138-f0fa-45d2-a1f4-7be2c965c1a9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:19.568321 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-42f13138-f0fa-45d2-a1f4-7be2c965c1a9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:19.568862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-42f13138-f0fa-45d2-a1f4-7be2c965c1a9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:19.569291 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-42f13138-f0fa-45d2-a1f4-7be2c965c1a9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:19.710993 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-42f13138-f0fa-45d2-a1f4-7be2c965c1a9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:19.724568 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-42f13138-f0fa-45d2-a1f4-7be2c965c1a9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.165832 Aug 31 11:45:19.729327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 189/377] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:19 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:20.746788 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5861cce9-f07a-4c0a-9d50-def8691be505 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:20.747858 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5861cce9-f07a-4c0a-9d50-def8691be505 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:20.758698 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5861cce9-f07a-4c0a-9d50-def8691be505 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:20.759474 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5861cce9-f07a-4c0a-9d50-def8691be505 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:20.759979 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5861cce9-f07a-4c0a-9d50-def8691be505 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:20.761086 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5861cce9-f07a-4c0a-9d50-def8691be505 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:20.761909 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5861cce9-f07a-4c0a-9d50-def8691be505 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:20.762703 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5861cce9-f07a-4c0a-9d50-def8691be505 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:20.933693 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5861cce9-f07a-4c0a-9d50-def8691be505 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:20.941873 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5861cce9-f07a-4c0a-9d50-def8691be505 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.200731 Aug 31 11:45:20.942511 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 189/378] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:20 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:21.963668 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6180813f-40a6-47ef-b2b7-885b0e41c91d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:21.964274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6180813f-40a6-47ef-b2b7-885b0e41c91d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:21.966603 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:45:21.972754 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6180813f-40a6-47ef-b2b7-885b0e41c91d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:21.973724 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6180813f-40a6-47ef-b2b7-885b0e41c91d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:21.974164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6180813f-40a6-47ef-b2b7-885b0e41c91d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:21.974853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6180813f-40a6-47ef-b2b7-885b0e41c91d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:21.975304 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6180813f-40a6-47ef-b2b7-885b0e41c91d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:21.975742 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6180813f-40a6-47ef-b2b7-885b0e41c91d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:22.110066 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6180813f-40a6-47ef-b2b7-885b0e41c91d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:22.117845 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6180813f-40a6-47ef-b2b7-885b0e41c91d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.157969 Aug 31 11:45:22.118405 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 190/379] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:21 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:23.143264 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-721772a1-d182-4eab-a37a-24e1b87e33ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:23.144794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-721772a1-d182-4eab-a37a-24e1b87e33ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:23.154257 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-721772a1-d182-4eab-a37a-24e1b87e33ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:23.154858 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-721772a1-d182-4eab-a37a-24e1b87e33ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:23.155364 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-721772a1-d182-4eab-a37a-24e1b87e33ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:23.156134 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-721772a1-d182-4eab-a37a-24e1b87e33ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:23.156620 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-721772a1-d182-4eab-a37a-24e1b87e33ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:23.157041 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-721772a1-d182-4eab-a37a-24e1b87e33ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:23.311893 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-721772a1-d182-4eab-a37a-24e1b87e33ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:23.321215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-721772a1-d182-4eab-a37a-24e1b87e33ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.185693 Aug 31 11:45:23.321799 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 190/380] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:23 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:45:24.345672 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7690a56a-f186-4437-97ec-6bd118105ce4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:24.346420 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7690a56a-f186-4437-97ec-6bd118105ce4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:24.353316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7690a56a-f186-4437-97ec-6bd118105ce4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:24.353797 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7690a56a-f186-4437-97ec-6bd118105ce4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:24.354229 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7690a56a-f186-4437-97ec-6bd118105ce4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:24.355060 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7690a56a-f186-4437-97ec-6bd118105ce4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:24.355548 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7690a56a-f186-4437-97ec-6bd118105ce4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:24.355965 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7690a56a-f186-4437-97ec-6bd118105ce4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:24.501539 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7690a56a-f186-4437-97ec-6bd118105ce4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:24.509996 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7690a56a-f186-4437-97ec-6bd118105ce4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.168461 Aug 31 11:45:24.510555 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 191/381] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:24 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:25.532248 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e54efa58-d8a6-4d7b-ac64-ed950a13be92 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:25.532882 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e54efa58-d8a6-4d7b-ac64-ed950a13be92 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:25.539224 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e54efa58-d8a6-4d7b-ac64-ed950a13be92 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:25.539706 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e54efa58-d8a6-4d7b-ac64-ed950a13be92 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:25.540137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e54efa58-d8a6-4d7b-ac64-ed950a13be92 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:25.540855 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e54efa58-d8a6-4d7b-ac64-ed950a13be92 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:25.541307 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e54efa58-d8a6-4d7b-ac64-ed950a13be92 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:25.541733 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e54efa58-d8a6-4d7b-ac64-ed950a13be92 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:25.671588 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e54efa58-d8a6-4d7b-ac64-ed950a13be92 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:25.680061 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e54efa58-d8a6-4d7b-ac64-ed950a13be92 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.151554 Aug 31 11:45:25.680654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 191/382] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:25 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:26.703242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b33ea92b-be8d-4e5f-9fa2-b345cc17b093 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:26.703850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b33ea92b-be8d-4e5f-9fa2-b345cc17b093 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:26.711199 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b33ea92b-be8d-4e5f-9fa2-b345cc17b093 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:26.711726 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b33ea92b-be8d-4e5f-9fa2-b345cc17b093 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:26.712308 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b33ea92b-be8d-4e5f-9fa2-b345cc17b093 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:26.712972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b33ea92b-be8d-4e5f-9fa2-b345cc17b093 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:26.713424 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b33ea92b-be8d-4e5f-9fa2-b345cc17b093 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:26.713908 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b33ea92b-be8d-4e5f-9fa2-b345cc17b093 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:26.848950 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b33ea92b-be8d-4e5f-9fa2-b345cc17b093 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:26.856703 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b33ea92b-be8d-4e5f-9fa2-b345cc17b093 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.157318 Aug 31 11:45:26.857254 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 192/383] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:26 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:27.876748 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1781d69d-5f36-48b3-be14-158fb977b0c6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:27.877349 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1781d69d-5f36-48b3-be14-158fb977b0c6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:27.883285 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1781d69d-5f36-48b3-be14-158fb977b0c6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:27.883747 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1781d69d-5f36-48b3-be14-158fb977b0c6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:27.884173 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1781d69d-5f36-48b3-be14-158fb977b0c6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:27.884955 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1781d69d-5f36-48b3-be14-158fb977b0c6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:27.885402 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1781d69d-5f36-48b3-be14-158fb977b0c6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:27.885825 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1781d69d-5f36-48b3-be14-158fb977b0c6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:28.016242 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1781d69d-5f36-48b3-be14-158fb977b0c6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:28.024701 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1781d69d-5f36-48b3-be14-158fb977b0c6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.151751 Aug 31 11:45:28.025262 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 192/384] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:27 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:29.045864 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3dd97356-aa69-41f1-9732-b3f33953384c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:29.046457 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3dd97356-aa69-41f1-9732-b3f33953384c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:29.053278 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3dd97356-aa69-41f1-9732-b3f33953384c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:29.053753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3dd97356-aa69-41f1-9732-b3f33953384c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:29.054181 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3dd97356-aa69-41f1-9732-b3f33953384c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:29.054979 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3dd97356-aa69-41f1-9732-b3f33953384c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:29.055428 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3dd97356-aa69-41f1-9732-b3f33953384c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:29.056007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3dd97356-aa69-41f1-9732-b3f33953384c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:29.190520 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3dd97356-aa69-41f1-9732-b3f33953384c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:29.198339 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3dd97356-aa69-41f1-9732-b3f33953384c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.156231 Aug 31 11:45:29.198894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 193/385] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:29 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:30.218903 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-afe52e3c-8d7d-4ca6-96b1-3e5a2ae99d0f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:30.219503 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-afe52e3c-8d7d-4ca6-96b1-3e5a2ae99d0f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:30.226601 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-afe52e3c-8d7d-4ca6-96b1-3e5a2ae99d0f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:30.227081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-afe52e3c-8d7d-4ca6-96b1-3e5a2ae99d0f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:30.227509 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-afe52e3c-8d7d-4ca6-96b1-3e5a2ae99d0f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:30.228199 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-afe52e3c-8d7d-4ca6-96b1-3e5a2ae99d0f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:30.228687 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-afe52e3c-8d7d-4ca6-96b1-3e5a2ae99d0f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:30.229261 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-afe52e3c-8d7d-4ca6-96b1-3e5a2ae99d0f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:30.438250 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-afe52e3c-8d7d-4ca6-96b1-3e5a2ae99d0f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:30.451607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-afe52e3c-8d7d-4ca6-96b1-3e5a2ae99d0f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.235797 Aug 31 11:45:30.452531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 193/386] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:30 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:31.473830 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b2a2b2e5-e0c1-4130-9d68-70abe2686dcb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:31.475176 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b2a2b2e5-e0c1-4130-9d68-70abe2686dcb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:31.481260 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b2a2b2e5-e0c1-4130-9d68-70abe2686dcb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:31.481733 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b2a2b2e5-e0c1-4130-9d68-70abe2686dcb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:31.482159 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b2a2b2e5-e0c1-4130-9d68-70abe2686dcb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:31.482839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b2a2b2e5-e0c1-4130-9d68-70abe2686dcb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:31.483285 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b2a2b2e5-e0c1-4130-9d68-70abe2686dcb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:31.483702 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b2a2b2e5-e0c1-4130-9d68-70abe2686dcb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:31.692043 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b2a2b2e5-e0c1-4130-9d68-70abe2686dcb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:31.700584 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b2a2b2e5-e0c1-4130-9d68-70abe2686dcb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.230677 Aug 31 11:45:31.701461 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 194/387] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:31 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:32.722547 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-665cf8b6-814b-43fa-8be4-b7941f8d33b1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:32.723176 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-665cf8b6-814b-43fa-8be4-b7941f8d33b1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:32.729895 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-665cf8b6-814b-43fa-8be4-b7941f8d33b1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:32.730375 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-665cf8b6-814b-43fa-8be4-b7941f8d33b1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:32.730799 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-665cf8b6-814b-43fa-8be4-b7941f8d33b1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:32.731507 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-665cf8b6-814b-43fa-8be4-b7941f8d33b1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:32.732003 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-665cf8b6-814b-43fa-8be4-b7941f8d33b1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:32.732429 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-665cf8b6-814b-43fa-8be4-b7941f8d33b1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:32.872040 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-665cf8b6-814b-43fa-8be4-b7941f8d33b1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:32.879780 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-665cf8b6-814b-43fa-8be4-b7941f8d33b1 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.160967 Aug 31 11:45:32.880968 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 194/388] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:32 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:33.901318 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b012009d-cee9-4dfa-bcea-646c7f4c6acd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:33.901862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b012009d-cee9-4dfa-bcea-646c7f4c6acd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:33.908456 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b012009d-cee9-4dfa-bcea-646c7f4c6acd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:33.908996 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b012009d-cee9-4dfa-bcea-646c7f4c6acd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:33.909737 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b012009d-cee9-4dfa-bcea-646c7f4c6acd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:33.910506 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b012009d-cee9-4dfa-bcea-646c7f4c6acd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:33.910953 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b012009d-cee9-4dfa-bcea-646c7f4c6acd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:33.911975 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b012009d-cee9-4dfa-bcea-646c7f4c6acd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:34.042608 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b012009d-cee9-4dfa-bcea-646c7f4c6acd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:34.050146 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b012009d-cee9-4dfa-bcea-646c7f4c6acd tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.152691 Aug 31 11:45:34.050701 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 195/389] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:33 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:35.071681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e1f86690-9182-4619-bbc2-445de5441c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:35.072295 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e1f86690-9182-4619-bbc2-445de5441c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:35.078227 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e1f86690-9182-4619-bbc2-445de5441c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:35.078710 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e1f86690-9182-4619-bbc2-445de5441c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:35.079143 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e1f86690-9182-4619-bbc2-445de5441c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:35.079829 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e1f86690-9182-4619-bbc2-445de5441c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:35.080280 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e1f86690-9182-4619-bbc2-445de5441c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:35.080739 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e1f86690-9182-4619-bbc2-445de5441c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:35.216620 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e1f86690-9182-4619-bbc2-445de5441c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:35.225338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e1f86690-9182-4619-bbc2-445de5441c75 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.157880 Aug 31 11:45:35.226360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 195/390] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:35 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:36.247974 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-819e2039-90f5-488c-980e-31d361f24886 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:36.248527 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-819e2039-90f5-488c-980e-31d361f24886 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:36.255822 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-819e2039-90f5-488c-980e-31d361f24886 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:36.256291 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-819e2039-90f5-488c-980e-31d361f24886 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:36.256756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-819e2039-90f5-488c-980e-31d361f24886 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:36.257435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-819e2039-90f5-488c-980e-31d361f24886 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:36.257885 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-819e2039-90f5-488c-980e-31d361f24886 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:36.258302 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-819e2039-90f5-488c-980e-31d361f24886 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:36.260817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=93 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:45:36.388412 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-819e2039-90f5-488c-980e-31d361f24886 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:36.396584 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-819e2039-90f5-488c-980e-31d361f24886 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.153646 Aug 31 11:45:36.397144 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 196/391] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:36 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:37.417520 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2d43e44a-e078-4999-ba56-7add643145b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:37.418058 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2d43e44a-e078-4999-ba56-7add643145b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:37.423945 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d43e44a-e078-4999-ba56-7add643145b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:37.424422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d43e44a-e078-4999-ba56-7add643145b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:37.424884 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d43e44a-e078-4999-ba56-7add643145b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:37.425559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d43e44a-e078-4999-ba56-7add643145b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:37.426007 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d43e44a-e078-4999-ba56-7add643145b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:37.426426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d43e44a-e078-4999-ba56-7add643145b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:37.555570 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2d43e44a-e078-4999-ba56-7add643145b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:37.563254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2d43e44a-e078-4999-ba56-7add643145b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.149656 Aug 31 11:45:37.563995 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 196/392] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:37 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:38.585110 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-877c4973-96a5-49f0-b871-85db9fe1387b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:38.585709 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-877c4973-96a5-49f0-b871-85db9fe1387b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:38.591974 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-877c4973-96a5-49f0-b871-85db9fe1387b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:38.592446 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-877c4973-96a5-49f0-b871-85db9fe1387b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:38.592902 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-877c4973-96a5-49f0-b871-85db9fe1387b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:38.593573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-877c4973-96a5-49f0-b871-85db9fe1387b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:38.594015 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-877c4973-96a5-49f0-b871-85db9fe1387b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:38.594429 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-877c4973-96a5-49f0-b871-85db9fe1387b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:38.747786 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-877c4973-96a5-49f0-b871-85db9fe1387b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:38.756046 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-877c4973-96a5-49f0-b871-85db9fe1387b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1521 microversion: 2.1 time: 0.175262 Aug 31 11:45:38.757088 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 197/393] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:38 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:39.777135 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-bd8e31c1-d80a-4f73-be91-5fa2bca9d796 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:39.777641 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-bd8e31c1-d80a-4f73-be91-5fa2bca9d796 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:39.783447 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bd8e31c1-d80a-4f73-be91-5fa2bca9d796 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:39.783962 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bd8e31c1-d80a-4f73-be91-5fa2bca9d796 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:39.784390 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bd8e31c1-d80a-4f73-be91-5fa2bca9d796 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:39.785082 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bd8e31c1-d80a-4f73-be91-5fa2bca9d796 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:39.785506 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bd8e31c1-d80a-4f73-be91-5fa2bca9d796 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:39.785921 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bd8e31c1-d80a-4f73-be91-5fa2bca9d796 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:39.919805 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-bd8e31c1-d80a-4f73-be91-5fa2bca9d796 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:39.927641 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-bd8e31c1-d80a-4f73-be91-5fa2bca9d796 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1501 microversion: 2.1 time: 0.154422 Aug 31 11:45:39.928212 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 197/394] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:39 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:39.947762 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-572d3781-86da-4448-91b7-2bb9dcd90bfe tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:39.948364 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-572d3781-86da-4448-91b7-2bb9dcd90bfe tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:39.954915 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-572d3781-86da-4448-91b7-2bb9dcd90bfe tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:39.955396 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-572d3781-86da-4448-91b7-2bb9dcd90bfe tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:39.955952 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-572d3781-86da-4448-91b7-2bb9dcd90bfe tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:39.956670 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-572d3781-86da-4448-91b7-2bb9dcd90bfe tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:39.957121 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-572d3781-86da-4448-91b7-2bb9dcd90bfe tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:39.957544 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-572d3781-86da-4448-91b7-2bb9dcd90bfe tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:40.095049 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-572d3781-86da-4448-91b7-2bb9dcd90bfe tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:40.102752 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-572d3781-86da-4448-91b7-2bb9dcd90bfe tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1515 microversion: 2.1 time: 0.158866 Aug 31 11:45:40.103406 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 198/395] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:39 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:42.559000 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-93d71078-ddbb-4d59-8cb8-15147fae41ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:45:42.561344 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-93d71078-ddbb-4d59-8cb8-15147fae41ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:42.568076 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-93d71078-ddbb-4d59-8cb8-15147fae41ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:42.568696 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-93d71078-ddbb-4d59-8cb8-15147fae41ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:42.569137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-93d71078-ddbb-4d59-8cb8-15147fae41ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:42.569836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-93d71078-ddbb-4d59-8cb8-15147fae41ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:42.570287 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-93d71078-ddbb-4d59-8cb8-15147fae41ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:42.570712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-93d71078-ddbb-4d59-8cb8-15147fae41ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:42.573258 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=77 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:45:42.601011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.objects.instance [None req-93d71078-ddbb-4d59-8cb8-15147fae41ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lazy-loading 'flavor' on Instance uuid 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab {{(pid=127062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:45:42.867653 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-93d71078-ddbb-4d59-8cb8-15147fae41ea tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "POST /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab/action" status: 200 len: 32 microversion: 2.1 time: 0.312828 Aug 31 11:45:42.868438 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 198/396] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 31 11:45:42 2022] POST /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab/action => generated 32 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 11:45:42.878625 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d80ffafb-faac-413b-a0b1-f62ee802e44e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:42.879372 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d80ffafb-faac-413b-a0b1-f62ee802e44e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:42.886481 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d80ffafb-faac-413b-a0b1-f62ee802e44e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:42.887143 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d80ffafb-faac-413b-a0b1-f62ee802e44e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:42.887779 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d80ffafb-faac-413b-a0b1-f62ee802e44e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:42.889329 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d80ffafb-faac-413b-a0b1-f62ee802e44e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:42.889787 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d80ffafb-faac-413b-a0b1-f62ee802e44e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:42.890510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d80ffafb-faac-413b-a0b1-f62ee802e44e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:43.031072 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d80ffafb-faac-413b-a0b1-f62ee802e44e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:43.042997 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d80ffafb-faac-413b-a0b1-f62ee802e44e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1521 microversion: 2.1 time: 0.168272 Aug 31 11:45:43.044128 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 199/397] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:42 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:44.063794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-258792b4-aa32-4bdf-82e3-db84ad62f01c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:44.064513 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-258792b4-aa32-4bdf-82e3-db84ad62f01c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:44.071883 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-258792b4-aa32-4bdf-82e3-db84ad62f01c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:44.072355 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-258792b4-aa32-4bdf-82e3-db84ad62f01c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:44.072835 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-258792b4-aa32-4bdf-82e3-db84ad62f01c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:44.073521 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-258792b4-aa32-4bdf-82e3-db84ad62f01c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:44.073972 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-258792b4-aa32-4bdf-82e3-db84ad62f01c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:44.074454 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-258792b4-aa32-4bdf-82e3-db84ad62f01c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:44.202184 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-258792b4-aa32-4bdf-82e3-db84ad62f01c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:44.210549 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-258792b4-aa32-4bdf-82e3-db84ad62f01c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1521 microversion: 2.1 time: 0.150836 Aug 31 11:45:44.211052 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 199/398] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:44 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:45:45.231467 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9629ab53-1cfb-470d-a8de-9512aa5d88f7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:45.231998 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9629ab53-1cfb-470d-a8de-9512aa5d88f7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:45.238583 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9629ab53-1cfb-470d-a8de-9512aa5d88f7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:45.239081 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9629ab53-1cfb-470d-a8de-9512aa5d88f7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:45.239513 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9629ab53-1cfb-470d-a8de-9512aa5d88f7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:45.240205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9629ab53-1cfb-470d-a8de-9512aa5d88f7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:45.240686 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9629ab53-1cfb-470d-a8de-9512aa5d88f7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:45.241190 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9629ab53-1cfb-470d-a8de-9512aa5d88f7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:45.405448 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9629ab53-1cfb-470d-a8de-9512aa5d88f7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:45.415583 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9629ab53-1cfb-470d-a8de-9512aa5d88f7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1521 microversion: 2.1 time: 0.188882 Aug 31 11:45:45.416251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 200/399] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:45 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:46.449501 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-65cd579a-dedf-422c-b810-e7e738d3b29b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:46.450413 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-65cd579a-dedf-422c-b810-e7e738d3b29b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:46.456632 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65cd579a-dedf-422c-b810-e7e738d3b29b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:46.457192 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65cd579a-dedf-422c-b810-e7e738d3b29b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:46.457727 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65cd579a-dedf-422c-b810-e7e738d3b29b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:46.458958 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65cd579a-dedf-422c-b810-e7e738d3b29b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:46.459477 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65cd579a-dedf-422c-b810-e7e738d3b29b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:46.460045 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65cd579a-dedf-422c-b810-e7e738d3b29b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:46.628990 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-65cd579a-dedf-422c-b810-e7e738d3b29b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:46.636773 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-65cd579a-dedf-422c-b810-e7e738d3b29b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1521 microversion: 2.1 time: 0.191067 Aug 31 11:45:46.637339 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 200/400] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:46 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:47.659123 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-02250494-f237-4409-b2c8-f7b2899542c4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:47.660563 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-02250494-f237-4409-b2c8-f7b2899542c4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:47.666756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-02250494-f237-4409-b2c8-f7b2899542c4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:47.675857 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-02250494-f237-4409-b2c8-f7b2899542c4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:47.677084 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-02250494-f237-4409-b2c8-f7b2899542c4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:47.678397 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-02250494-f237-4409-b2c8-f7b2899542c4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:47.680652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-02250494-f237-4409-b2c8-f7b2899542c4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:47.681449 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-02250494-f237-4409-b2c8-f7b2899542c4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:47.897331 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-02250494-f237-4409-b2c8-f7b2899542c4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:47.917206 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-02250494-f237-4409-b2c8-f7b2899542c4 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1521 microversion: 2.1 time: 0.261898 Aug 31 11:45:47.917786 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 201/401] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:47 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:48.954312 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-dc94372d-70f1-4766-8ca5-0decf9df59c3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:48.955102 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-dc94372d-70f1-4766-8ca5-0decf9df59c3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:48.957160 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=26 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:45:48.964024 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dc94372d-70f1-4766-8ca5-0decf9df59c3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:48.964512 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dc94372d-70f1-4766-8ca5-0decf9df59c3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:48.965164 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dc94372d-70f1-4766-8ca5-0decf9df59c3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:48.966055 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dc94372d-70f1-4766-8ca5-0decf9df59c3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:48.966681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dc94372d-70f1-4766-8ca5-0decf9df59c3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:48.967263 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dc94372d-70f1-4766-8ca5-0decf9df59c3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:49.231868 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-dc94372d-70f1-4766-8ca5-0decf9df59c3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:49.246847 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-dc94372d-70f1-4766-8ca5-0decf9df59c3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1521 microversion: 2.1 time: 0.296422 Aug 31 11:45:49.250378 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 201/402] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:48 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:50.278996 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-05ddaf11-1bc9-42b6-b39e-4901431c6100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:50.279618 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-05ddaf11-1bc9-42b6-b39e-4901431c6100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:50.287327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-05ddaf11-1bc9-42b6-b39e-4901431c6100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:50.287807 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-05ddaf11-1bc9-42b6-b39e-4901431c6100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:50.288374 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-05ddaf11-1bc9-42b6-b39e-4901431c6100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:50.289110 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-05ddaf11-1bc9-42b6-b39e-4901431c6100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:50.289557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-05ddaf11-1bc9-42b6-b39e-4901431c6100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:50.289976 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-05ddaf11-1bc9-42b6-b39e-4901431c6100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:50.448216 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-05ddaf11-1bc9-42b6-b39e-4901431c6100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:50.459924 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-05ddaf11-1bc9-42b6-b39e-4901431c6100 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1521 microversion: 2.1 time: 0.189926 Aug 31 11:45:50.460935 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 202/403] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:50 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:51.491873 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c61f80c8-6611-49fd-b585-70601d67482c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:51.493409 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c61f80c8-6611-49fd-b585-70601d67482c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:51.500300 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c61f80c8-6611-49fd-b585-70601d67482c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:51.500930 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c61f80c8-6611-49fd-b585-70601d67482c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:51.501457 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c61f80c8-6611-49fd-b585-70601d67482c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:51.503632 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c61f80c8-6611-49fd-b585-70601d67482c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:51.504252 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c61f80c8-6611-49fd-b585-70601d67482c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:51.507486 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c61f80c8-6611-49fd-b585-70601d67482c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:51.768707 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c61f80c8-6611-49fd-b585-70601d67482c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:51.778753 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c61f80c8-6611-49fd-b585-70601d67482c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1521 microversion: 2.1 time: 0.298876 Aug 31 11:45:51.779863 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 202/404] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:51 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:52.799586 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c3a7f178-f5fe-40a7-9c13-d97fe53d669e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:52.800798 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c3a7f178-f5fe-40a7-9c13-d97fe53d669e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:52.804438 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=26 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:45:52.815591 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3a7f178-f5fe-40a7-9c13-d97fe53d669e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:52.816844 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3a7f178-f5fe-40a7-9c13-d97fe53d669e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:52.819193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3a7f178-f5fe-40a7-9c13-d97fe53d669e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:52.820239 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3a7f178-f5fe-40a7-9c13-d97fe53d669e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:52.821492 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3a7f178-f5fe-40a7-9c13-d97fe53d669e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:52.824556 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3a7f178-f5fe-40a7-9c13-d97fe53d669e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:53.094093 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c3a7f178-f5fe-40a7-9c13-d97fe53d669e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:53.109870 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c3a7f178-f5fe-40a7-9c13-d97fe53d669e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1521 microversion: 2.1 time: 0.313922 Aug 31 11:45:53.128873 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 203/405] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:52 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:54.131682 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a86c5af0-0a54-4a9b-bef1-54dd06493c94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:54.132972 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a86c5af0-0a54-4a9b-bef1-54dd06493c94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:54.144335 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a86c5af0-0a54-4a9b-bef1-54dd06493c94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:54.144882 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a86c5af0-0a54-4a9b-bef1-54dd06493c94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:54.146057 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a86c5af0-0a54-4a9b-bef1-54dd06493c94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:54.146946 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a86c5af0-0a54-4a9b-bef1-54dd06493c94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:54.147392 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a86c5af0-0a54-4a9b-bef1-54dd06493c94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:54.147836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a86c5af0-0a54-4a9b-bef1-54dd06493c94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:54.430304 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a86c5af0-0a54-4a9b-bef1-54dd06493c94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:54.447472 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a86c5af0-0a54-4a9b-bef1-54dd06493c94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1521 microversion: 2.1 time: 0.320216 Aug 31 11:45:54.449772 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 203/406] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:54 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:55.470357 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-af3bc9a9-6911-4b79-9597-b26603c613e8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:55.470973 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-af3bc9a9-6911-4b79-9597-b26603c613e8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:55.482819 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af3bc9a9-6911-4b79-9597-b26603c613e8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:55.483308 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af3bc9a9-6911-4b79-9597-b26603c613e8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:55.483737 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af3bc9a9-6911-4b79-9597-b26603c613e8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:55.484442 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af3bc9a9-6911-4b79-9597-b26603c613e8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:55.484992 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af3bc9a9-6911-4b79-9597-b26603c613e8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:55.486007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af3bc9a9-6911-4b79-9597-b26603c613e8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:56.264978 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-af3bc9a9-6911-4b79-9597-b26603c613e8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:56.280389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-af3bc9a9-6911-4b79-9597-b26603c613e8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1521 microversion: 2.1 time: 0.813437 Aug 31 11:45:56.282165 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 204/407] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:55 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1521 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:57.303525 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7c78df35-efe4-4f17-b53a-aa4f5f5d3040 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:57.304170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-7c78df35-efe4-4f17-b53a-aa4f5f5d3040 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:57.314969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c78df35-efe4-4f17-b53a-aa4f5f5d3040 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:57.315483 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c78df35-efe4-4f17-b53a-aa4f5f5d3040 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:57.316198 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c78df35-efe4-4f17-b53a-aa4f5f5d3040 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:57.320721 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c78df35-efe4-4f17-b53a-aa4f5f5d3040 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:57.321421 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c78df35-efe4-4f17-b53a-aa4f5f5d3040 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:57.323650 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c78df35-efe4-4f17-b53a-aa4f5f5d3040 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:57.556131 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7c78df35-efe4-4f17-b53a-aa4f5f5d3040 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:57.572088 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-7c78df35-efe4-4f17-b53a-aa4f5f5d3040 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1521 microversion: 2.1 time: 0.271002 Aug 31 11:45:57.572740 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 204/408] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:57 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:58.595110 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f9ba4649-7e01-4285-b536-2cde5b31b7f3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:58.595721 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f9ba4649-7e01-4285-b536-2cde5b31b7f3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:58.602416 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f9ba4649-7e01-4285-b536-2cde5b31b7f3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:58.602909 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f9ba4649-7e01-4285-b536-2cde5b31b7f3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:58.603405 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f9ba4649-7e01-4285-b536-2cde5b31b7f3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:58.604110 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f9ba4649-7e01-4285-b536-2cde5b31b7f3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:58.604592 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f9ba4649-7e01-4285-b536-2cde5b31b7f3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:58.605031 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f9ba4649-7e01-4285-b536-2cde5b31b7f3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:58.785679 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f9ba4649-7e01-4285-b536-2cde5b31b7f3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:58.799984 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f9ba4649-7e01-4285-b536-2cde5b31b7f3 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1501 microversion: 2.1 time: 0.208628 Aug 31 11:45:58.824721 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 205/409] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:58 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1501 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:58.827081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1cdd3e7d-a591-496e-8db7-aec4d06f5a96 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc40da86-6f70-4bb1-a940-dc1dc5e70b6f"}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:45:58.834937 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1cdd3e7d-a591-496e-8db7-aec4d06f5a96 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:58.843060 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1cdd3e7d-a591-496e-8db7-aec4d06f5a96 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:58.845967 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1cdd3e7d-a591-496e-8db7-aec4d06f5a96 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:58.846419 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1cdd3e7d-a591-496e-8db7-aec4d06f5a96 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:58.847249 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1cdd3e7d-a591-496e-8db7-aec4d06f5a96 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:58.847709 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1cdd3e7d-a591-496e-8db7-aec4d06f5a96 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:58.854545 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1cdd3e7d-a591-496e-8db7-aec4d06f5a96 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:58.881918 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1713608927", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "networks": [{"uuid": "b4ba5a0c-7e98-402d-9c47-67ed978b7684"}]}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:45:58.901111 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-1cdd3e7d-a591-496e-8db7-aec4d06f5a96 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] HTTP exception thrown: Cannot 'attach_volume' instance 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab while it is in vm_state rescued Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1cdd3e7d-a591-496e-8db7-aec4d06f5a96 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Request method failure captured: Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: POST /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab/os-volume_attachments HTTP/1.1 Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 74 Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lTBYSI4Ellx1xSTrjGIoKiHgxhum85uyJe7v4p_7ezDgEUywOkeRvVgpwndDzyP6iljpAIyETuLAQabjcJl_KtU2r016DHL9lHZfhqzY9WRA62hsyCCf3I5xWBvvNZ5KLZHqUR5mR5wFwxzMbvDmChRreNmXS89FadI3ywt7qNUEw Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 0e110109075848a89e6ae1d516de9784 Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2086882469 Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:45:58.903276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:45:58.904591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0e110109075848a89e6ae1d516de9784", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0e110109075848a89e6ae1d516de9784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e110109075848a89e6ae1d516de9784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e110109075848a89e6ae1d516de9784"}]}] Aug 31 11:45:58.904591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2086882469 Aug 31 11:45:58.904591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 0e110109075848a89e6ae1d516de9784 Aug 31 11:45:58.904591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2086882469 Aug 31 11:45:58.904591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-ServerRescueNegativeTestJSON-2086882469-project Aug 31 11:45:58.904591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:45:58.904591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:45:58.904591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 38ea91bf04e741c793e4a06db9fb046f Aug 31 11:45:58.904591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2086882469-project Aug 31 11:45:58.904591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Aug 31 11:45:58.904591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {"volumeAttachment": {"volumeId": "fc40da86-6f70-4bb1-a940-dc1dc5e70b6f"}} Aug 31 11:45:58.904591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Cannot 'attach_volume' instance 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab while it is in vm_state rescued Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'server_id': '5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab', 'body': {'volumeAttachment': {'volumeId': 'fc40da86-6f70-4bb1-a940-dc1dc5e70b6f'}}} Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:45:58.905325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab while it is in vm_state rescued Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:45:58.906464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:45:58.907504 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:45:58.907504 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:45:58.907504 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab while it is in vm_state rescued Aug 31 11:45:58.907504 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:45:58.909662 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1cdd3e7d-a591-496e-8db7-aec4d06f5a96 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Returning 409 to user: Cannot 'attach_volume' instance 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab while it is in vm_state rescued {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:45:58.910910 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1cdd3e7d-a591-496e-8db7-aec4d06f5a96 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "POST /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.091869 Aug 31 11:45:58.911574 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 205/410] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 31 11:45:58 2022] POST /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab/os-volume_attachments => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 11:45:58.920394 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d62e3ef6-018d-4e17-935d-8ff1dfba0e67 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:45:58.921194 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d62e3ef6-018d-4e17-935d-8ff1dfba0e67 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:58.930007 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d62e3ef6-018d-4e17-935d-8ff1dfba0e67 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:58.930698 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d62e3ef6-018d-4e17-935d-8ff1dfba0e67 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:58.931321 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d62e3ef6-018d-4e17-935d-8ff1dfba0e67 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:58.932133 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d62e3ef6-018d-4e17-935d-8ff1dfba0e67 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:58.932794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d62e3ef6-018d-4e17-935d-8ff1dfba0e67 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:58.933916 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d62e3ef6-018d-4e17-935d-8ff1dfba0e67 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:58.963750 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.network.neutron [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] validate_networks() for [('b4ba5a0c-7e98-402d-9c47-67ed978b7684', None, None, None, None, None)] {{(pid=127061) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:45:59.026526 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d62e3ef6-018d-4e17-935d-8ff1dfba0e67 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "POST /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab/action" status: 202 len: 0 microversion: 2.1 time: 0.109343 Aug 31 11:45:59.030978 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 206/411] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 31 11:45:58 2022] POST /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:45:59.043905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b588558e-dd32-47cf-bdd3-9a9201e71d25 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:45:59.044942 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b588558e-dd32-47cf-bdd3-9a9201e71d25 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:45:59.055380 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b588558e-dd32-47cf-bdd3-9a9201e71d25 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:59.056918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b588558e-dd32-47cf-bdd3-9a9201e71d25 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:59.057598 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b588558e-dd32-47cf-bdd3-9a9201e71d25 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:59.059008 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b588558e-dd32-47cf-bdd3-9a9201e71d25 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:59.059656 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b588558e-dd32-47cf-bdd3-9a9201e71d25 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:59.060386 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b588558e-dd32-47cf-bdd3-9a9201e71d25 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:59.607422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b588558e-dd32-47cf-bdd3-9a9201e71d25 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:45:59.619144 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b588558e-dd32-47cf-bdd3-9a9201e71d25 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1509 microversion: 2.1 time: 0.581013 Aug 31 11:45:59.633485 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 207/412] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:45:59 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1509 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:45:59.805611 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Flavor limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:45:59.806167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Image limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:45:59.806565 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Flavor pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:45:59.806963 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Image pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:45:59.807682 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:45:59.824521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:59.827525 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:59.828057 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:59.831669 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:45:59.832226 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:45:59.833753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:45:59.887929 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Getting quotas for project f8f83820c15b492c9013ff8345668b63. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:45:59.898823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Getting quotas for user 007760fc26c64cc9a9a3e6ea4325af31 and project f8f83820c15b492c9013ff8345668b63. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:45:59.928183 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Going to run 1 instances... {{(pid=127061) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:45:59.935127 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127061) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:46:00.088234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c4d23469-473f-4c0e-94ea-f91ad4a609fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.214521 Aug 31 11:46:00.099589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 206/413] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:45:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:46:00.102232 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9bbdd48b-4b0c-45e2-91c5-214c8aff5759 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:00.103270 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9bbdd48b-4b0c-45e2-91c5-214c8aff5759 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:00.302073 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9bbdd48b-4b0c-45e2-91c5-214c8aff5759 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:00.314409 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9bbdd48b-4b0c-45e2-91c5-214c8aff5759 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1219 microversion: 2.1 time: 0.218503 Aug 31 11:46:00.326061 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 208/414] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:00 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1219 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:00.642407 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c8851a7e-9c04-4ad5-8dbe-097b563b9ee5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:00.643368 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c8851a7e-9c04-4ad5-8dbe-097b563b9ee5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:00.651618 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c8851a7e-9c04-4ad5-8dbe-097b563b9ee5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:00.656231 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c8851a7e-9c04-4ad5-8dbe-097b563b9ee5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:00.657794 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c8851a7e-9c04-4ad5-8dbe-097b563b9ee5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:00.659453 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c8851a7e-9c04-4ad5-8dbe-097b563b9ee5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:00.660192 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c8851a7e-9c04-4ad5-8dbe-097b563b9ee5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:00.663087 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c8851a7e-9c04-4ad5-8dbe-097b563b9ee5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:00.881032 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c8851a7e-9c04-4ad5-8dbe-097b563b9ee5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:00.902518 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c8851a7e-9c04-4ad5-8dbe-097b563b9ee5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1509 microversion: 2.1 time: 0.264169 Aug 31 11:46:00.918018 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 207/415] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:00 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:01.357524 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cc1c9249-1c13-45eb-882a-fcef20934e63 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:01.358124 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cc1c9249-1c13-45eb-882a-fcef20934e63 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:01.375147 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc1c9249-1c13-45eb-882a-fcef20934e63 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:01.375646 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc1c9249-1c13-45eb-882a-fcef20934e63 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:01.376087 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc1c9249-1c13-45eb-882a-fcef20934e63 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:01.376862 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc1c9249-1c13-45eb-882a-fcef20934e63 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:01.377319 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc1c9249-1c13-45eb-882a-fcef20934e63 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:01.377747 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc1c9249-1c13-45eb-882a-fcef20934e63 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:01.492990 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cc1c9249-1c13-45eb-882a-fcef20934e63 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:01.501614 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cc1c9249-1c13-45eb-882a-fcef20934e63 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1223 microversion: 2.1 time: 0.150879 Aug 31 11:46:01.502685 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 209/416] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:01 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1223 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:01.925675 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e50fcacb-2e61-4bbb-a37d-692b8d422e2d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:01.927888 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e50fcacb-2e61-4bbb-a37d-692b8d422e2d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:01.934356 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e50fcacb-2e61-4bbb-a37d-692b8d422e2d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:01.934769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e50fcacb-2e61-4bbb-a37d-692b8d422e2d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:01.935207 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e50fcacb-2e61-4bbb-a37d-692b8d422e2d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:01.935898 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e50fcacb-2e61-4bbb-a37d-692b8d422e2d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:01.936351 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e50fcacb-2e61-4bbb-a37d-692b8d422e2d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:01.936804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e50fcacb-2e61-4bbb-a37d-692b8d422e2d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:02.108434 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e50fcacb-2e61-4bbb-a37d-692b8d422e2d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:02.118063 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e50fcacb-2e61-4bbb-a37d-692b8d422e2d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1509 microversion: 2.1 time: 0.196686 Aug 31 11:46:02.119680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 208/417] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:01 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:02.523412 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ffc99f10-93d0-4de3-805f-a4b9faa3a905 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:02.524955 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ffc99f10-93d0-4de3-805f-a4b9faa3a905 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:02.535854 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ffc99f10-93d0-4de3-805f-a4b9faa3a905 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:02.536627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ffc99f10-93d0-4de3-805f-a4b9faa3a905 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:02.537209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ffc99f10-93d0-4de3-805f-a4b9faa3a905 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:02.538110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ffc99f10-93d0-4de3-805f-a4b9faa3a905 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:02.540298 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ffc99f10-93d0-4de3-805f-a4b9faa3a905 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:02.540947 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ffc99f10-93d0-4de3-805f-a4b9faa3a905 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:02.669900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ffc99f10-93d0-4de3-805f-a4b9faa3a905 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:02.693542 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ffc99f10-93d0-4de3-805f-a4b9faa3a905 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1223 microversion: 2.1 time: 0.174215 Aug 31 11:46:02.694661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 210/418] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:02 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1223 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:03.141055 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2f59a0f4-6990-4f66-afb7-889605a209f5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:03.141668 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2f59a0f4-6990-4f66-afb7-889605a209f5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:03.168938 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f59a0f4-6990-4f66-afb7-889605a209f5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:03.170226 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f59a0f4-6990-4f66-afb7-889605a209f5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:03.171903 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f59a0f4-6990-4f66-afb7-889605a209f5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:03.182284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f59a0f4-6990-4f66-afb7-889605a209f5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:03.186077 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f59a0f4-6990-4f66-afb7-889605a209f5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:03.186953 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f59a0f4-6990-4f66-afb7-889605a209f5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:03.460280 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2f59a0f4-6990-4f66-afb7-889605a209f5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:03.475763 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2f59a0f4-6990-4f66-afb7-889605a209f5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1509 microversion: 2.1 time: 0.338958 Aug 31 11:46:03.477844 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 209/419] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:03 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1509 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:03.719891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-550f424c-bee9-4bce-b6d8-d116bbfefa99 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:03.721246 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-550f424c-bee9-4bce-b6d8-d116bbfefa99 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:03.729197 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-550f424c-bee9-4bce-b6d8-d116bbfefa99 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:03.730083 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-550f424c-bee9-4bce-b6d8-d116bbfefa99 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:03.730742 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-550f424c-bee9-4bce-b6d8-d116bbfefa99 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:03.731672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-550f424c-bee9-4bce-b6d8-d116bbfefa99 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:03.732342 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-550f424c-bee9-4bce-b6d8-d116bbfefa99 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:03.733023 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-550f424c-bee9-4bce-b6d8-d116bbfefa99 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:03.800771 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-550f424c-bee9-4bce-b6d8-d116bbfefa99 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:03.811450 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-550f424c-bee9-4bce-b6d8-d116bbfefa99 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1215 microversion: 2.1 time: 0.096099 Aug 31 11:46:03.812034 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 211/420] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:03 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:04.498327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bbf2ef6f-4a05-44d3-86cf-4d4752d6715b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:04.498937 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-bbf2ef6f-4a05-44d3-86cf-4d4752d6715b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:04.507170 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbf2ef6f-4a05-44d3-86cf-4d4752d6715b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:04.507933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbf2ef6f-4a05-44d3-86cf-4d4752d6715b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:04.508629 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbf2ef6f-4a05-44d3-86cf-4d4752d6715b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:04.509966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbf2ef6f-4a05-44d3-86cf-4d4752d6715b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:04.510905 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbf2ef6f-4a05-44d3-86cf-4d4752d6715b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:04.511263 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbf2ef6f-4a05-44d3-86cf-4d4752d6715b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:04.709139 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-bbf2ef6f-4a05-44d3-86cf-4d4752d6715b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:04.721079 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-bbf2ef6f-4a05-44d3-86cf-4d4752d6715b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1515 microversion: 2.1 time: 0.226939 Aug 31 11:46:04.721575 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 210/421] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:04 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1515 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:04.834148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-690e5462-ddf7-4012-91e8-2d7c000c449c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:04.834741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-690e5462-ddf7-4012-91e8-2d7c000c449c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:04.863284 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-690e5462-ddf7-4012-91e8-2d7c000c449c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:04.865662 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-690e5462-ddf7-4012-91e8-2d7c000c449c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:04.867152 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-690e5462-ddf7-4012-91e8-2d7c000c449c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:04.867895 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-690e5462-ddf7-4012-91e8-2d7c000c449c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:04.868353 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-690e5462-ddf7-4012-91e8-2d7c000c449c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:04.869052 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-690e5462-ddf7-4012-91e8-2d7c000c449c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:05.013236 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-690e5462-ddf7-4012-91e8-2d7c000c449c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:05.022883 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-690e5462-ddf7-4012-91e8-2d7c000c449c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1271 microversion: 2.1 time: 0.192666 Aug 31 11:46:05.025291 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 212/422] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:04 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:06.045420 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f78e3f0b-1013-4937-99df-7f6297de7ea1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:06.046024 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f78e3f0b-1013-4937-99df-7f6297de7ea1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:06.064810 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f78e3f0b-1013-4937-99df-7f6297de7ea1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:06.065290 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f78e3f0b-1013-4937-99df-7f6297de7ea1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:06.066179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f78e3f0b-1013-4937-99df-7f6297de7ea1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:06.066974 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f78e3f0b-1013-4937-99df-7f6297de7ea1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:06.067574 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f78e3f0b-1013-4937-99df-7f6297de7ea1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:06.068155 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f78e3f0b-1013-4937-99df-7f6297de7ea1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:06.166657 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f78e3f0b-1013-4937-99df-7f6297de7ea1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:06.175332 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f78e3f0b-1013-4937-99df-7f6297de7ea1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1277 microversion: 2.1 time: 0.133653 Aug 31 11:46:06.177616 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 211/423] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:06 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1277 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:06.279195 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2fb0c05e-cfc8-49d6-8588-48b7a1396897 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Action: 'create', calling method: .version_select at 0x7f1735753ca0>, body: {"keypair": {"name": "tempest-keypair-485942118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwEF9AYjCitnlzTyIaTqkZVhlHHx2dTptvcepBE6vRJ9Q09TNRW3N/gfQNIitpUyuXPt2uSfzmNw4rQ1UWSIdi2b4/7fuo09Vm000VMzXNCIJL2U2u/+J+/avFeInagPg=="}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:06.298884 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-2fb0c05e-cfc8-49d6-8588-48b7a1396897 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Getting quotas for project 0e110109075848a89e6ae1d516de9784. Resources: {'key_pairs'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:46:06.305142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-2fb0c05e-cfc8-49d6-8588-48b7a1396897 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Getting quotas for user 38ea91bf04e741c793e4a06db9fb046f and project 0e110109075848a89e6ae1d516de9784. Resources: {'key_pairs'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:46:06.367961 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2fb0c05e-cfc8-49d6-8588-48b7a1396897 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.092632 Aug 31 11:46:06.378939 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 213/424] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 31 11:46:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:46:07.203762 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d2184b74-0990-4a3a-818b-bcbe296af530 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:07.203762 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d2184b74-0990-4a3a-818b-bcbe296af530 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:07.211909 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d2184b74-0990-4a3a-818b-bcbe296af530 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:07.216558 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d2184b74-0990-4a3a-818b-bcbe296af530 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:07.217348 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d2184b74-0990-4a3a-818b-bcbe296af530 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:07.218713 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d2184b74-0990-4a3a-818b-bcbe296af530 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:07.220957 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d2184b74-0990-4a3a-818b-bcbe296af530 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:07.221835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d2184b74-0990-4a3a-818b-bcbe296af530 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:07.228102 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=92 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:07.435348 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d2184b74-0990-4a3a-818b-bcbe296af530 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:07.447404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d2184b74-0990-4a3a-818b-bcbe296af530 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1277 microversion: 2.1 time: 0.249871 Aug 31 11:46:07.450642 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 212/425] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:07 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:08.383724 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-ae41c83f-7988-42f6-8b9c-9c340c394f93 req-60c3b66f-c835-41f2-bcf3-c267556282d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68ed39e-e5a3-446a-b3a1-88b2cca92714", "tag": "3faabfae-6033-4b82-aa6c-e9e920a8fb64"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:08.405532 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-ae41c83f-7988-42f6-8b9c-9c340c394f93 req-60c3b66f-c835-41f2-bcf3-c267556282d5 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:08.406866 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-ae41c83f-7988-42f6-8b9c-9c340c394f93 req-60c3b66f-c835-41f2-bcf3-c267556282d5 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:08.411385 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-ae41c83f-7988-42f6-8b9c-9c340c394f93 req-60c3b66f-c835-41f2-bcf3-c267556282d5 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:08.442991 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:08.454405 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-ae41c83f-7988-42f6-8b9c-9c340c394f93 req-60c3b66f-c835-41f2-bcf3-c267556282d5 service nova] Creating event network-changed:3faabfae-6033-4b82-aa6c-e9e920a8fb64 for instance b68ed39e-e5a3-446a-b3a1-88b2cca92714 on hv-cinder-83976 Aug 31 11:46:08.465828 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-ae41c83f-7988-42f6-8b9c-9c340c394f93 req-60c3b66f-c835-41f2-bcf3-c267556282d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087944 Aug 31 11:46:08.472463 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0d431837-2bec-4948-8a3e-eb89519d8074 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:08.474809 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-0d431837-2bec-4948-8a3e-eb89519d8074 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:08.478725 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 214/426] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:46:08.482647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0d431837-2bec-4948-8a3e-eb89519d8074 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:08.487309 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0d431837-2bec-4948-8a3e-eb89519d8074 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:08.488280 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0d431837-2bec-4948-8a3e-eb89519d8074 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:08.489819 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0d431837-2bec-4948-8a3e-eb89519d8074 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:08.491211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0d431837-2bec-4948-8a3e-eb89519d8074 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:08.493043 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0d431837-2bec-4948-8a3e-eb89519d8074 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:08.731205 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2056544739", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b93944f3-e7dd-4293-9c55-c0bafd4cda29"}], "security_groups": [{"name": "tempest-securitygroup--772389848"}], "key_name": "tempest-keypair-485942118", "user_data": "}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:08.759723 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0d431837-2bec-4948-8a3e-eb89519d8074 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:08.767902 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0d431837-2bec-4948-8a3e-eb89519d8074 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.299992 Aug 31 11:46:08.772719 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 213/427] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:08 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:08.930671 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.network.neutron [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] validate_networks() for [('b93944f3-e7dd-4293-9c55-c0bafd4cda29', None, None, None, None, None)] {{(pid=127062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:46:09.473939 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Flavor limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:46:09.475214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Image limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:46:09.478463 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Flavor pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:46:09.478998 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Image pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:46:09.479550 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:46:09.493496 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:09.494310 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:09.494903 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:09.495862 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:09.497333 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:09.497928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:09.522407 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Getting quotas for project 0e110109075848a89e6ae1d516de9784. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:46:09.527991 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Getting quotas for user 38ea91bf04e741c793e4a06db9fb046f and project 0e110109075848a89e6ae1d516de9784. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:46:09.542210 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Going to run 1 instances... {{(pid=127062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:46:09.545684 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:46:09.609591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a855dca1-75c8-4f8b-84d5-f7bfb00bfc16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.882819 Aug 31 11:46:09.610637 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 215/428] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:46:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:46:09.621365 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-82b45ddb-11ba-4c33-b666-3e7d39fea976 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:09.621973 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-82b45ddb-11ba-4c33-b666-3e7d39fea976 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:09.710762 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-82b45ddb-11ba-4c33-b666-3e7d39fea976 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:09.721454 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-82b45ddb-11ba-4c33-b666-3e7d39fea976 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1245 microversion: 2.1 time: 0.103451 Aug 31 11:46:09.722790 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 214/429] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:09 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:09.791433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cdca0523-a68d-44f8-9657-9d9e9b9b68c1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:09.792045 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cdca0523-a68d-44f8-9657-9d9e9b9b68c1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:09.802081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdca0523-a68d-44f8-9657-9d9e9b9b68c1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:09.804011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdca0523-a68d-44f8-9657-9d9e9b9b68c1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:09.805353 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdca0523-a68d-44f8-9657-9d9e9b9b68c1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:09.807443 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdca0523-a68d-44f8-9657-9d9e9b9b68c1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:09.812894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdca0523-a68d-44f8-9657-9d9e9b9b68c1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:09.813397 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdca0523-a68d-44f8-9657-9d9e9b9b68c1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:09.995927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cdca0523-a68d-44f8-9657-9d9e9b9b68c1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:10.007536 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cdca0523-a68d-44f8-9657-9d9e9b9b68c1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.220135 Aug 31 11:46:10.021227 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 216/430] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:09 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:10.749199 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3ac4d379-0f71-4c0d-bb09-9e09cd4b7c13 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:10.750542 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3ac4d379-0f71-4c0d-bb09-9e09cd4b7c13 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:10.752719 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:10.759627 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3ac4d379-0f71-4c0d-bb09-9e09cd4b7c13 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:10.760382 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3ac4d379-0f71-4c0d-bb09-9e09cd4b7c13 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:10.761040 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3ac4d379-0f71-4c0d-bb09-9e09cd4b7c13 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:10.761951 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3ac4d379-0f71-4c0d-bb09-9e09cd4b7c13 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:10.762628 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3ac4d379-0f71-4c0d-bb09-9e09cd4b7c13 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:10.763134 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3ac4d379-0f71-4c0d-bb09-9e09cd4b7c13 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:10.829793 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3ac4d379-0f71-4c0d-bb09-9e09cd4b7c13 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:10.839602 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3ac4d379-0f71-4c0d-bb09-9e09cd4b7c13 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1249 microversion: 2.1 time: 0.094345 Aug 31 11:46:10.840700 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 215/431] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:10 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:11.029432 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-024ca96a-4b60-41ab-9b36-7411b3c0e82c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:11.030065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-024ca96a-4b60-41ab-9b36-7411b3c0e82c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:11.037917 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-024ca96a-4b60-41ab-9b36-7411b3c0e82c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:11.038974 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-024ca96a-4b60-41ab-9b36-7411b3c0e82c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:11.039578 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-024ca96a-4b60-41ab-9b36-7411b3c0e82c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:11.040299 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-024ca96a-4b60-41ab-9b36-7411b3c0e82c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:11.040935 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-024ca96a-4b60-41ab-9b36-7411b3c0e82c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:11.041386 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-024ca96a-4b60-41ab-9b36-7411b3c0e82c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:11.198831 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-024ca96a-4b60-41ab-9b36-7411b3c0e82c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:11.212506 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-024ca96a-4b60-41ab-9b36-7411b3c0e82c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.187006 Aug 31 11:46:11.216446 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 217/432] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:11 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:11.681219 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-46fdb855-9944-4d2c-8733-503fa2beb21a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Action: 'create', calling method: .version_select at 0x7f1734c1d3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1131327028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWzPKoyTuI8Vq1n4RsyE4B5wOZi33QdZl2CzLZUhUCZf4OQu9hItgPT+FMdagI/FJcHqAeLrwlV7+sQZvpTSl3BgQhfLUql69fkMUTAAbfG9ITf9L4mj127EzwdJbfTIg=="}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:11.697417 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-46fdb855-9944-4d2c-8733-503fa2beb21a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Getting quotas for project e4e02b8409eb43e1bd1d68c79e985430. Resources: {'key_pairs'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:46:11.701271 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-46fdb855-9944-4d2c-8733-503fa2beb21a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Getting quotas for user 255f7abaa92444309e5bf97f9d91c840 and project e4e02b8409eb43e1bd1d68c79e985430. Resources: {'key_pairs'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:46:11.713130 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR oslo.messaging._drivers.impl_rabbit [None req-46fdb855-9944-4d2c-8733-503fa2beb21a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [8180460a-08d6-4528-82cd-dc1536f0c278] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 11:46:11.861000 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c061ccbb-d290-4ac4-b606-e674351f2425 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:11.861607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c061ccbb-d290-4ac4-b606-e674351f2425 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:11.868333 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c061ccbb-d290-4ac4-b606-e674351f2425 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:11.868839 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c061ccbb-d290-4ac4-b606-e674351f2425 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:11.869271 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c061ccbb-d290-4ac4-b606-e674351f2425 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:11.869983 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c061ccbb-d290-4ac4-b606-e674351f2425 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:11.870420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c061ccbb-d290-4ac4-b606-e674351f2425 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:11.870843 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c061ccbb-d290-4ac4-b606-e674351f2425 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:11.930432 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c061ccbb-d290-4ac4-b606-e674351f2425 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:11.937823 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c061ccbb-d290-4ac4-b606-e674351f2425 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1249 microversion: 2.1 time: 0.080694 Aug 31 11:46:11.938379 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 218/433] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:11 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:12.233094 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cf0a4879-6d71-48c7-b942-f4bc007d9148 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:12.233780 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cf0a4879-6d71-48c7-b942-f4bc007d9148 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:12.240710 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf0a4879-6d71-48c7-b942-f4bc007d9148 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:12.241247 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf0a4879-6d71-48c7-b942-f4bc007d9148 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:12.241722 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf0a4879-6d71-48c7-b942-f4bc007d9148 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:12.242322 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf0a4879-6d71-48c7-b942-f4bc007d9148 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:12.242773 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf0a4879-6d71-48c7-b942-f4bc007d9148 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:12.243327 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf0a4879-6d71-48c7-b942-f4bc007d9148 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:12.470866 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cf0a4879-6d71-48c7-b942-f4bc007d9148 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:12.478503 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cf0a4879-6d71-48c7-b942-f4bc007d9148 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.249203 Aug 31 11:46:12.479065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 219/434] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:12 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:12.722760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO oslo.messaging._drivers.impl_rabbit [None req-46fdb855-9944-4d2c-8733-503fa2beb21a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [8180460a-08d6-4528-82cd-dc1536f0c278] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 56070. Aug 31 11:46:12.742745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-46fdb855-9944-4d2c-8733-503fa2beb21a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.065377 Aug 31 11:46:12.743826 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 216/435] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 31 11:46:11 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:46:12.861675 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-970553248", "imageRef": "56354906-1f47-4837-8fb5-cea4e82c2fe4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1131327028", "networks": [{"uuid": "6f7dae35-03aa-45a5-929f-5a4c3b9cd184"}]}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:12.932643 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.network.neutron [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] validate_networks() for [('6f7dae35-03aa-45a5-929f-5a4c3b9cd184', None, None, None, None, None)] {{(pid=127062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:46:12.960005 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0af9ce8e-cb04-47e1-9732-a0d1dfe60537 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:12.961139 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-0af9ce8e-cb04-47e1-9732-a0d1dfe60537 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:12.976294 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0af9ce8e-cb04-47e1-9732-a0d1dfe60537 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:12.978155 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0af9ce8e-cb04-47e1-9732-a0d1dfe60537 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:12.978604 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0af9ce8e-cb04-47e1-9732-a0d1dfe60537 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:12.979397 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0af9ce8e-cb04-47e1-9732-a0d1dfe60537 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:12.979864 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0af9ce8e-cb04-47e1-9732-a0d1dfe60537 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:12.983271 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0af9ce8e-cb04-47e1-9732-a0d1dfe60537 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:13.080968 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0af9ce8e-cb04-47e1-9732-a0d1dfe60537 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:13.093639 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0af9ce8e-cb04-47e1-9732-a0d1dfe60537 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1303 microversion: 2.1 time: 0.138379 Aug 31 11:46:13.112638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 217/436] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:12 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:13.499020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a3e8df27-38bf-4240-9e81-823310c4e500 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:13.499891 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a3e8df27-38bf-4240-9e81-823310c4e500 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:13.507258 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a3e8df27-38bf-4240-9e81-823310c4e500 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:13.508166 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a3e8df27-38bf-4240-9e81-823310c4e500 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:13.508865 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a3e8df27-38bf-4240-9e81-823310c4e500 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:13.510878 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a3e8df27-38bf-4240-9e81-823310c4e500 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:13.512053 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a3e8df27-38bf-4240-9e81-823310c4e500 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:13.512831 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a3e8df27-38bf-4240-9e81-823310c4e500 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:13.645985 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Flavor limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:46:13.647116 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Image limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:46:13.647116 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Flavor pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:46:13.647544 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Image pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:46:13.648515 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:46:13.658530 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:13.659275 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:13.659705 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:13.660423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:13.661092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:13.661762 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:13.683436 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Getting quotas for project e4e02b8409eb43e1bd1d68c79e985430. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:46:13.689855 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Getting quotas for user 255f7abaa92444309e5bf97f9d91c840 and project e4e02b8409eb43e1bd1d68c79e985430. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:46:13.703564 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Going to run 1 instances... {{(pid=127062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:46:13.705737 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56354906-1f47-4837-8fb5-cea4e82c2fe4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:46:13.720963 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a3e8df27-38bf-4240-9e81-823310c4e500 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:13.731991 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a3e8df27-38bf-4240-9e81-823310c4e500 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.236671 Aug 31 11:46:13.747280 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 218/437] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:13 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:13.780667 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b5997e7a-e5f9-416b-b260-bf9b2780d33c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.923181 Aug 31 11:46:13.781311 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 220/438] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:46:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:46:13.794060 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-09ba079e-54a3-4044-95e8-417481301d44 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:13.794671 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-09ba079e-54a3-4044-95e8-417481301d44 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:13.865808 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-09ba079e-54a3-4044-95e8-417481301d44 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:13.875593 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-09ba079e-54a3-4044-95e8-417481301d44 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1258 microversion: 2.1 time: 0.085707 Aug 31 11:46:13.876164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 219/439] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:13 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:14.125637 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7bcfec6b-ca69-4c40-97e9-107edd70a868 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:14.125637 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-7bcfec6b-ca69-4c40-97e9-107edd70a868 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:14.134782 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7bcfec6b-ca69-4c40-97e9-107edd70a868 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:14.135463 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7bcfec6b-ca69-4c40-97e9-107edd70a868 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:14.136114 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7bcfec6b-ca69-4c40-97e9-107edd70a868 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:14.137475 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7bcfec6b-ca69-4c40-97e9-107edd70a868 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:14.138274 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7bcfec6b-ca69-4c40-97e9-107edd70a868 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:14.139076 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7bcfec6b-ca69-4c40-97e9-107edd70a868 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:14.656932 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7bcfec6b-ca69-4c40-97e9-107edd70a868 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:14.668942 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-7bcfec6b-ca69-4c40-97e9-107edd70a868 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.552913 Aug 31 11:46:14.670241 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 221/440] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:14 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:14.757429 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1c8b2620-6348-45ef-b6c0-2cccba221d02 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:14.759453 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1c8b2620-6348-45ef-b6c0-2cccba221d02 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:14.789410 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1c8b2620-6348-45ef-b6c0-2cccba221d02 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:14.790446 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1c8b2620-6348-45ef-b6c0-2cccba221d02 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:14.791068 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1c8b2620-6348-45ef-b6c0-2cccba221d02 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:14.792582 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1c8b2620-6348-45ef-b6c0-2cccba221d02 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:14.792582 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1c8b2620-6348-45ef-b6c0-2cccba221d02 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:14.793019 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1c8b2620-6348-45ef-b6c0-2cccba221d02 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:14.901152 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cbbbfa6c-e6cf-4cea-ac58-91d21f2b456a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:14.902813 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cbbbfa6c-e6cf-4cea-ac58-91d21f2b456a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:14.917653 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cbbbfa6c-e6cf-4cea-ac58-91d21f2b456a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:14.921001 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cbbbfa6c-e6cf-4cea-ac58-91d21f2b456a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:14.921650 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cbbbfa6c-e6cf-4cea-ac58-91d21f2b456a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:14.922428 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cbbbfa6c-e6cf-4cea-ac58-91d21f2b456a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:14.925951 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cbbbfa6c-e6cf-4cea-ac58-91d21f2b456a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:14.926448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cbbbfa6c-e6cf-4cea-ac58-91d21f2b456a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:14.991941 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1c8b2620-6348-45ef-b6c0-2cccba221d02 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:15.000322 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1c8b2620-6348-45ef-b6c0-2cccba221d02 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.249473 Aug 31 11:46:15.000926 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 220/441] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:14 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:15.025249 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-161fdf2d-7321-4113-bae3-3399b03215df req-a2815eb1-eba3-4988-b21b-4ec9ae1599da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68ed39e-e5a3-446a-b3a1-88b2cca92714", "name": "network-vif-plugged", "status": "completed", "tag": "3faabfae-6033-4b82-aa6c-e9e920a8fb64"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:15.038496 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-161fdf2d-7321-4113-bae3-3399b03215df req-a2815eb1-eba3-4988-b21b-4ec9ae1599da service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:15.038983 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-161fdf2d-7321-4113-bae3-3399b03215df req-a2815eb1-eba3-4988-b21b-4ec9ae1599da service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:15.039459 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-161fdf2d-7321-4113-bae3-3399b03215df req-a2815eb1-eba3-4988-b21b-4ec9ae1599da service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:15.047191 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cbbbfa6c-e6cf-4cea-ac58-91d21f2b456a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:15.057192 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-161fdf2d-7321-4113-bae3-3399b03215df req-a2815eb1-eba3-4988-b21b-4ec9ae1599da service nova] Creating event network-vif-plugged:3faabfae-6033-4b82-aa6c-e9e920a8fb64 for instance b68ed39e-e5a3-446a-b3a1-88b2cca92714 on hv-cinder-83976 Aug 31 11:46:15.060293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cbbbfa6c-e6cf-4cea-ac58-91d21f2b456a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1310 microversion: 2.1 time: 0.164498 Aug 31 11:46:15.061267 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 222/442] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:14 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1310 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:15.078384 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-161fdf2d-7321-4113-bae3-3399b03215df req-a2815eb1-eba3-4988-b21b-4ec9ae1599da service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056729 Aug 31 11:46:15.080401 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 221/443] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:46:15.159005 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-fb23a1ca-dc98-4ec0-a2cf-48dbeaffc023 req-c71955e6-d959-4dd4-9426-a10f67623930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a75232d-2df1-41c7-b73d-762fba8bd8e6", "tag": "e4add15e-9a0d-473c-9f93-9c2dbb5dee25"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:15.171312 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-fb23a1ca-dc98-4ec0-a2cf-48dbeaffc023 req-c71955e6-d959-4dd4-9426-a10f67623930 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:15.172117 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-fb23a1ca-dc98-4ec0-a2cf-48dbeaffc023 req-c71955e6-d959-4dd4-9426-a10f67623930 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:15.172686 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-fb23a1ca-dc98-4ec0-a2cf-48dbeaffc023 req-c71955e6-d959-4dd4-9426-a10f67623930 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:15.188529 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-fb23a1ca-dc98-4ec0-a2cf-48dbeaffc023 req-c71955e6-d959-4dd4-9426-a10f67623930 service nova] Creating event network-changed:e4add15e-9a0d-473c-9f93-9c2dbb5dee25 for instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 on hv-cinder-83976 Aug 31 11:46:15.194849 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-fb23a1ca-dc98-4ec0-a2cf-48dbeaffc023 req-c71955e6-d959-4dd4-9426-a10f67623930 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043161 Aug 31 11:46:15.195964 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 223/444] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:46:15.690684 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a76176c2-3b62-4853-a205-15df201140c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:15.691634 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a76176c2-3b62-4853-a205-15df201140c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:15.698524 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a76176c2-3b62-4853-a205-15df201140c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:15.698994 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a76176c2-3b62-4853-a205-15df201140c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:15.699418 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a76176c2-3b62-4853-a205-15df201140c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:15.700085 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a76176c2-3b62-4853-a205-15df201140c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:15.700544 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a76176c2-3b62-4853-a205-15df201140c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:15.700960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a76176c2-3b62-4853-a205-15df201140c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:15.832208 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a76176c2-3b62-4853-a205-15df201140c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:15.840028 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a76176c2-3b62-4853-a205-15df201140c0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.153502 Aug 31 11:46:15.840592 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 222/445] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:15 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:16.027291 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ece5823f-079a-463a-8855-ca0c86791aef tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:16.027975 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ece5823f-079a-463a-8855-ca0c86791aef tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:16.034211 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ece5823f-079a-463a-8855-ca0c86791aef tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:16.034881 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ece5823f-079a-463a-8855-ca0c86791aef tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:16.035310 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ece5823f-079a-463a-8855-ca0c86791aef tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:16.035995 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ece5823f-079a-463a-8855-ca0c86791aef tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:16.036481 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ece5823f-079a-463a-8855-ca0c86791aef tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:16.036987 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ece5823f-079a-463a-8855-ca0c86791aef tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:16.082210 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f60d542b-5dfc-4026-8cdb-18f00c80d361 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:16.083068 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f60d542b-5dfc-4026-8cdb-18f00c80d361 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:16.089176 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f60d542b-5dfc-4026-8cdb-18f00c80d361 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:16.089873 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f60d542b-5dfc-4026-8cdb-18f00c80d361 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:16.090476 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f60d542b-5dfc-4026-8cdb-18f00c80d361 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:16.091329 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f60d542b-5dfc-4026-8cdb-18f00c80d361 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:16.091922 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f60d542b-5dfc-4026-8cdb-18f00c80d361 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:16.092507 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f60d542b-5dfc-4026-8cdb-18f00c80d361 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:16.165567 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f60d542b-5dfc-4026-8cdb-18f00c80d361 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:16.174141 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f60d542b-5dfc-4026-8cdb-18f00c80d361 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1316 microversion: 2.1 time: 0.095831 Aug 31 11:46:16.174716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 223/446] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:16 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1316 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:16.279624 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ece5823f-079a-463a-8855-ca0c86791aef tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:16.291339 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ece5823f-079a-463a-8855-ca0c86791aef tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.267570 Aug 31 11:46:16.306547 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 224/447] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:16 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:16.482632 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-265721988", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452"}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:16.538255 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.network.neutron [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] validate_networks() for None {{(pid=127061) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:46:16.866453 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0d99a9d5-bf4e-440f-8c72-55c58e3cca4b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:16.867318 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0d99a9d5-bf4e-440f-8c72-55c58e3cca4b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:16.874276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0d99a9d5-bf4e-440f-8c72-55c58e3cca4b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:16.875134 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0d99a9d5-bf4e-440f-8c72-55c58e3cca4b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:16.875808 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0d99a9d5-bf4e-440f-8c72-55c58e3cca4b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:16.876775 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0d99a9d5-bf4e-440f-8c72-55c58e3cca4b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:16.877448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0d99a9d5-bf4e-440f-8c72-55c58e3cca4b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:16.878166 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0d99a9d5-bf4e-440f-8c72-55c58e3cca4b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:16.894702 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Flavor limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:46:16.895677 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Image limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:46:16.896189 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Flavor pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:46:16.896775 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Image pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:46:16.897195 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:46:16.906602 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:16.907297 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:16.907731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:16.908681 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:16.909137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:16.909560 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:16.930445 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Getting quotas for project 2351e519c01641e7aa832e41ad030cf8. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:46:16.934925 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Getting quotas for user c14dfcf40ed34d0b912599cbafeef8ca and project 2351e519c01641e7aa832e41ad030cf8. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:46:16.947582 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Going to run 1 instances... {{(pid=127061) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:46:16.950506 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127061) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:46:17.010268 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6cb17cff-7193-4679-842d-e6b6c34cfad4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532142 Aug 31 11:46:17.011199 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 224/448] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:46:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 11:46:17.023189 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-614499af-a9a7-4624-bf81-ef2386bfd857 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:17.024055 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-614499af-a9a7-4624-bf81-ef2386bfd857 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:17.081690 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0d99a9d5-bf4e-440f-8c72-55c58e3cca4b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:17.090620 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0d99a9d5-bf4e-440f-8c72-55c58e3cca4b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.233695 Aug 31 11:46:17.091201 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 225/449] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:16 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:17.094839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-614499af-a9a7-4624-bf81-ef2386bfd857 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:17.105079 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-614499af-a9a7-4624-bf81-ef2386bfd857 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1214 microversion: 2.1 time: 0.087039 Aug 31 11:46:17.114345 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 225/450] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:17 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:17.195860 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d24f1e3d-3fb4-4beb-940a-ae8579407884 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:17.196642 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d24f1e3d-3fb4-4beb-940a-ae8579407884 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:17.210511 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d24f1e3d-3fb4-4beb-940a-ae8579407884 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:17.211001 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d24f1e3d-3fb4-4beb-940a-ae8579407884 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:17.211483 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d24f1e3d-3fb4-4beb-940a-ae8579407884 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:17.212107 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d24f1e3d-3fb4-4beb-940a-ae8579407884 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:17.212574 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d24f1e3d-3fb4-4beb-940a-ae8579407884 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:17.212987 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d24f1e3d-3fb4-4beb-940a-ae8579407884 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:17.327177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-923da7df-d28e-4e78-a888-7cbfaa45de7d tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:17.331617 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-923da7df-d28e-4e78-a888-7cbfaa45de7d tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:17.345638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-923da7df-d28e-4e78-a888-7cbfaa45de7d tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:17.354763 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-923da7df-d28e-4e78-a888-7cbfaa45de7d tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:17.355250 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-923da7df-d28e-4e78-a888-7cbfaa45de7d tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:17.356214 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-923da7df-d28e-4e78-a888-7cbfaa45de7d tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:17.356868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-923da7df-d28e-4e78-a888-7cbfaa45de7d tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:17.357323 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-923da7df-d28e-4e78-a888-7cbfaa45de7d tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:17.369815 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d24f1e3d-3fb4-4beb-940a-ae8579407884 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:17.385889 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d24f1e3d-3fb4-4beb-940a-ae8579407884 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.194319 Aug 31 11:46:17.400259 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 226/451] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:17 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:17.513814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-923da7df-d28e-4e78-a888-7cbfaa45de7d tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:17.523212 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-923da7df-d28e-4e78-a888-7cbfaa45de7d tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.209974 Aug 31 11:46:17.524260 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 226/452] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:17 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:18.111243 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e4b9f58f-4c73-4e43-9a9b-836ce694fe65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:18.111979 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e4b9f58f-4c73-4e43-9a9b-836ce694fe65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:18.118875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e4b9f58f-4c73-4e43-9a9b-836ce694fe65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:18.119468 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e4b9f58f-4c73-4e43-9a9b-836ce694fe65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:18.119969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e4b9f58f-4c73-4e43-9a9b-836ce694fe65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:18.120692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e4b9f58f-4c73-4e43-9a9b-836ce694fe65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:18.121137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e4b9f58f-4c73-4e43-9a9b-836ce694fe65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:18.121550 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e4b9f58f-4c73-4e43-9a9b-836ce694fe65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:18.127053 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ed7f298c-e134-4313-b842-7bb9a68f1f89 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:18.128244 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ed7f298c-e134-4313-b842-7bb9a68f1f89 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:18.135488 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed7f298c-e134-4313-b842-7bb9a68f1f89 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:18.136270 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed7f298c-e134-4313-b842-7bb9a68f1f89 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:18.136768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed7f298c-e134-4313-b842-7bb9a68f1f89 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:18.137470 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed7f298c-e134-4313-b842-7bb9a68f1f89 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:18.138120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed7f298c-e134-4313-b842-7bb9a68f1f89 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:18.138549 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed7f298c-e134-4313-b842-7bb9a68f1f89 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:18.207634 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ed7f298c-e134-4313-b842-7bb9a68f1f89 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:18.216116 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ed7f298c-e134-4313-b842-7bb9a68f1f89 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1218 microversion: 2.1 time: 0.092997 Aug 31 11:46:18.216874 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 227/453] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:18 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:18.265935 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e4b9f58f-4c73-4e43-9a9b-836ce694fe65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:18.275309 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e4b9f58f-4c73-4e43-9a9b-836ce694fe65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.167854 Aug 31 11:46:18.275884 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 227/454] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:18 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:18.407410 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d4606c5b-6282-4655-bcaa-55e7567c7a33 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:18.408058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d4606c5b-6282-4655-bcaa-55e7567c7a33 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:18.414827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d4606c5b-6282-4655-bcaa-55e7567c7a33 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:18.415304 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d4606c5b-6282-4655-bcaa-55e7567c7a33 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:18.415734 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d4606c5b-6282-4655-bcaa-55e7567c7a33 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:18.416420 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d4606c5b-6282-4655-bcaa-55e7567c7a33 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:18.416894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d4606c5b-6282-4655-bcaa-55e7567c7a33 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:18.417310 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d4606c5b-6282-4655-bcaa-55e7567c7a33 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:18.543987 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1b808b91-5dd7-466d-b8c8-51a192e9b824 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:18.545052 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1b808b91-5dd7-466d-b8c8-51a192e9b824 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:18.550182 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d4606c5b-6282-4655-bcaa-55e7567c7a33 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:18.558076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d4606c5b-6282-4655-bcaa-55e7567c7a33 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.154695 Aug 31 11:46:18.558646 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 228/455] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:18 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:18.559917 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b808b91-5dd7-466d-b8c8-51a192e9b824 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:18.560403 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b808b91-5dd7-466d-b8c8-51a192e9b824 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:18.561024 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b808b91-5dd7-466d-b8c8-51a192e9b824 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:18.561879 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b808b91-5dd7-466d-b8c8-51a192e9b824 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:18.562821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b808b91-5dd7-466d-b8c8-51a192e9b824 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:18.563399 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1b808b91-5dd7-466d-b8c8-51a192e9b824 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:18.701410 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1b808b91-5dd7-466d-b8c8-51a192e9b824 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:18.710548 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1b808b91-5dd7-466d-b8c8-51a192e9b824 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.170425 Aug 31 11:46:18.711135 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 228/456] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:18 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:19.238402 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6de51545-9ee1-477f-b02b-076043e2498d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:19.239121 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6de51545-9ee1-477f-b02b-076043e2498d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:19.248156 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6de51545-9ee1-477f-b02b-076043e2498d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:19.248813 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6de51545-9ee1-477f-b02b-076043e2498d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:19.249325 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6de51545-9ee1-477f-b02b-076043e2498d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:19.250098 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6de51545-9ee1-477f-b02b-076043e2498d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:19.250879 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6de51545-9ee1-477f-b02b-076043e2498d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:19.251311 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6de51545-9ee1-477f-b02b-076043e2498d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:19.296352 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2caf689f-ab02-4bde-9e67-b2a77508fd4e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:19.297614 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2caf689f-ab02-4bde-9e67-b2a77508fd4e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:19.300848 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:19.305718 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2caf689f-ab02-4bde-9e67-b2a77508fd4e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:19.306207 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2caf689f-ab02-4bde-9e67-b2a77508fd4e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:19.306638 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2caf689f-ab02-4bde-9e67-b2a77508fd4e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:19.307339 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2caf689f-ab02-4bde-9e67-b2a77508fd4e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:19.307784 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2caf689f-ab02-4bde-9e67-b2a77508fd4e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:19.308209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2caf689f-ab02-4bde-9e67-b2a77508fd4e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:19.316562 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6de51545-9ee1-477f-b02b-076043e2498d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:19.324278 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6de51545-9ee1-477f-b02b-076043e2498d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1218 microversion: 2.1 time: 0.090145 Aug 31 11:46:19.324901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 229/457] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:19 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:19.459026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2caf689f-ab02-4bde-9e67-b2a77508fd4e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:19.467081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2caf689f-ab02-4bde-9e67-b2a77508fd4e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.174487 Aug 31 11:46:19.467659 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 229/458] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:19 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:19.582300 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f09a2b23-84b3-4951-9438-8f4e989bfa7c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:19.582917 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f09a2b23-84b3-4951-9438-8f4e989bfa7c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:19.589683 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f09a2b23-84b3-4951-9438-8f4e989bfa7c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:19.590169 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f09a2b23-84b3-4951-9438-8f4e989bfa7c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:19.590604 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f09a2b23-84b3-4951-9438-8f4e989bfa7c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:19.591327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f09a2b23-84b3-4951-9438-8f4e989bfa7c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:19.591774 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f09a2b23-84b3-4951-9438-8f4e989bfa7c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:19.592208 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f09a2b23-84b3-4951-9438-8f4e989bfa7c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:19.726950 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f09a2b23-84b3-4951-9438-8f4e989bfa7c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:19.732038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-68f4c452-990e-4492-9659-9bbf1d0bddda tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:19.732713 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-68f4c452-990e-4492-9659-9bbf1d0bddda tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:19.736294 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f09a2b23-84b3-4951-9438-8f4e989bfa7c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.157782 Aug 31 11:46:19.737009 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 230/459] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:19 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:19.738919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-68f4c452-990e-4492-9659-9bbf1d0bddda tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:19.739445 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-68f4c452-990e-4492-9659-9bbf1d0bddda tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:19.740617 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-68f4c452-990e-4492-9659-9bbf1d0bddda tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:19.741503 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-68f4c452-990e-4492-9659-9bbf1d0bddda tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:19.742151 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-68f4c452-990e-4492-9659-9bbf1d0bddda tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:19.742736 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-68f4c452-990e-4492-9659-9bbf1d0bddda tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:19.879324 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-68f4c452-990e-4492-9659-9bbf1d0bddda tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:19.887858 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-68f4c452-990e-4492-9659-9bbf1d0bddda tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.159621 Aug 31 11:46:19.888592 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 230/460] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:19 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:20.345153 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-28489b1b-86fa-478d-9726-b5f3f57e420e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:20.345749 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-28489b1b-86fa-478d-9726-b5f3f57e420e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:20.348313 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:20.355373 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-28489b1b-86fa-478d-9726-b5f3f57e420e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:20.355863 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-28489b1b-86fa-478d-9726-b5f3f57e420e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:20.356298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-28489b1b-86fa-478d-9726-b5f3f57e420e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:20.357024 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-28489b1b-86fa-478d-9726-b5f3f57e420e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:20.357476 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-28489b1b-86fa-478d-9726-b5f3f57e420e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:20.357898 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-28489b1b-86fa-478d-9726-b5f3f57e420e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:20.424604 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-28489b1b-86fa-478d-9726-b5f3f57e420e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:20.433018 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-28489b1b-86fa-478d-9726-b5f3f57e420e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1218 microversion: 2.1 time: 0.091738 Aug 31 11:46:20.433579 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 231/461] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:20 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:20.488712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-703280d9-4f0b-400d-983e-dd2ffad6f9f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:20.489321 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-703280d9-4f0b-400d-983e-dd2ffad6f9f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:20.496006 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-703280d9-4f0b-400d-983e-dd2ffad6f9f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:20.496516 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-703280d9-4f0b-400d-983e-dd2ffad6f9f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:20.496954 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-703280d9-4f0b-400d-983e-dd2ffad6f9f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:20.497644 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-703280d9-4f0b-400d-983e-dd2ffad6f9f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:20.498097 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-703280d9-4f0b-400d-983e-dd2ffad6f9f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:20.498517 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-703280d9-4f0b-400d-983e-dd2ffad6f9f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:20.629829 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-703280d9-4f0b-400d-983e-dd2ffad6f9f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:20.638149 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-703280d9-4f0b-400d-983e-dd2ffad6f9f2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.153348 Aug 31 11:46:20.638724 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 231/462] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:20 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:20.758114 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-70d34799-4456-4e50-acea-42b33c428f65 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:20.759255 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-70d34799-4456-4e50-acea-42b33c428f65 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:20.765745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-70d34799-4456-4e50-acea-42b33c428f65 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:20.766217 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-70d34799-4456-4e50-acea-42b33c428f65 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:20.766639 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-70d34799-4456-4e50-acea-42b33c428f65 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:20.767322 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-70d34799-4456-4e50-acea-42b33c428f65 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:20.767768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-70d34799-4456-4e50-acea-42b33c428f65 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:20.768181 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-70d34799-4456-4e50-acea-42b33c428f65 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:20.899646 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-70d34799-4456-4e50-acea-42b33c428f65 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:20.909149 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-70d34799-4456-4e50-acea-42b33c428f65 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.155989 Aug 31 11:46:20.909902 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 232/463] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:20 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:20.910017 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-190dbffe-c710-4588-9380-d89bd35205a3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:20.910663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-190dbffe-c710-4588-9380-d89bd35205a3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:20.917696 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-190dbffe-c710-4588-9380-d89bd35205a3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:20.918181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-190dbffe-c710-4588-9380-d89bd35205a3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:20.918613 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-190dbffe-c710-4588-9380-d89bd35205a3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:20.919304 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-190dbffe-c710-4588-9380-d89bd35205a3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:20.919752 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-190dbffe-c710-4588-9380-d89bd35205a3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:20.920174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-190dbffe-c710-4588-9380-d89bd35205a3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:21.056474 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-190dbffe-c710-4588-9380-d89bd35205a3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:21.064422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-190dbffe-c710-4588-9380-d89bd35205a3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.158395 Aug 31 11:46:21.065251 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 232/464] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:20 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:21.454418 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-572486ea-f065-4143-91c2-6249b50632ba tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:21.455191 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-572486ea-f065-4143-91c2-6249b50632ba tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:21.465190 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-572486ea-f065-4143-91c2-6249b50632ba tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:21.465680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-572486ea-f065-4143-91c2-6249b50632ba tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:21.466113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-572486ea-f065-4143-91c2-6249b50632ba tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:21.466813 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-572486ea-f065-4143-91c2-6249b50632ba tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:21.467261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-572486ea-f065-4143-91c2-6249b50632ba tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:21.467692 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-572486ea-f065-4143-91c2-6249b50632ba tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:21.530755 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-572486ea-f065-4143-91c2-6249b50632ba tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:21.539707 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-572486ea-f065-4143-91c2-6249b50632ba tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1218 microversion: 2.1 time: 0.089092 Aug 31 11:46:21.540544 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 233/465] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:21 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:21.658825 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cb8aebef-a20e-480e-9bdf-40b679feb722 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:21.659426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cb8aebef-a20e-480e-9bdf-40b679feb722 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:21.667911 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cb8aebef-a20e-480e-9bdf-40b679feb722 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:21.668403 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cb8aebef-a20e-480e-9bdf-40b679feb722 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:21.669142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cb8aebef-a20e-480e-9bdf-40b679feb722 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:21.670290 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cb8aebef-a20e-480e-9bdf-40b679feb722 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:21.670757 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cb8aebef-a20e-480e-9bdf-40b679feb722 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:21.671189 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cb8aebef-a20e-480e-9bdf-40b679feb722 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:21.687950 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:21.810512 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cb8aebef-a20e-480e-9bdf-40b679feb722 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:21.819353 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cb8aebef-a20e-480e-9bdf-40b679feb722 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.164299 Aug 31 11:46:21.819922 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 233/466] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:21 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:21.931844 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-cab92f3e-d381-441a-a118-e8c80011dba8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:21.932463 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-cab92f3e-d381-441a-a118-e8c80011dba8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:21.938398 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cab92f3e-d381-441a-a118-e8c80011dba8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:21.938876 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cab92f3e-d381-441a-a118-e8c80011dba8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:21.939300 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cab92f3e-d381-441a-a118-e8c80011dba8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:21.939988 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cab92f3e-d381-441a-a118-e8c80011dba8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:21.940432 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cab92f3e-d381-441a-a118-e8c80011dba8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:21.940870 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cab92f3e-d381-441a-a118-e8c80011dba8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:21.944634 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:22.078514 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-cab92f3e-d381-441a-a118-e8c80011dba8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:22.085586 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-22a9804b-0f8d-498b-bcaa-bf3262150475 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:22.086328 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-22a9804b-0f8d-498b-bcaa-bf3262150475 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:22.092339 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22a9804b-0f8d-498b-bcaa-bf3262150475 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:22.092862 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22a9804b-0f8d-498b-bcaa-bf3262150475 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:22.093204 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-cab92f3e-d381-441a-a118-e8c80011dba8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.165179 Aug 31 11:46:22.093385 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22a9804b-0f8d-498b-bcaa-bf3262150475 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:22.094084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22a9804b-0f8d-498b-bcaa-bf3262150475 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:22.094213 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 234/467] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:21 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:22.094540 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22a9804b-0f8d-498b-bcaa-bf3262150475 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:22.094965 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22a9804b-0f8d-498b-bcaa-bf3262150475 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:22.227973 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-22a9804b-0f8d-498b-bcaa-bf3262150475 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:22.235782 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-22a9804b-0f8d-498b-bcaa-bf3262150475 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.154064 Aug 31 11:46:22.236383 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 234/468] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:22 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:22.561941 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c0d8561e-e735-4895-b749-8ddc454656d3 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:22.562585 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c0d8561e-e735-4895-b749-8ddc454656d3 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:22.570293 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0d8561e-e735-4895-b749-8ddc454656d3 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:22.570816 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0d8561e-e735-4895-b749-8ddc454656d3 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:22.571248 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0d8561e-e735-4895-b749-8ddc454656d3 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:22.571951 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0d8561e-e735-4895-b749-8ddc454656d3 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:22.572398 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0d8561e-e735-4895-b749-8ddc454656d3 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:22.572849 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0d8561e-e735-4895-b749-8ddc454656d3 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:22.638214 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c0d8561e-e735-4895-b749-8ddc454656d3 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:22.646075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c0d8561e-e735-4895-b749-8ddc454656d3 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1218 microversion: 2.1 time: 0.087913 Aug 31 11:46:22.646755 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 235/469] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:22 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:22.839388 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-653a5b01-d1b3-4577-8c7b-57cb40e108b6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:22.840003 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-653a5b01-d1b3-4577-8c7b-57cb40e108b6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:22.845956 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-653a5b01-d1b3-4577-8c7b-57cb40e108b6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:22.846440 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-653a5b01-d1b3-4577-8c7b-57cb40e108b6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:22.846875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-653a5b01-d1b3-4577-8c7b-57cb40e108b6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:22.847570 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-653a5b01-d1b3-4577-8c7b-57cb40e108b6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:22.848022 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-653a5b01-d1b3-4577-8c7b-57cb40e108b6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:22.848446 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-653a5b01-d1b3-4577-8c7b-57cb40e108b6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:22.987298 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-653a5b01-d1b3-4577-8c7b-57cb40e108b6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:22.995834 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-653a5b01-d1b3-4577-8c7b-57cb40e108b6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.160268 Aug 31 11:46:22.996391 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 235/470] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:22 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:23.113446 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1d6a97cf-4120-41d0-a421-8c48be438319 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:23.113964 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1d6a97cf-4120-41d0-a421-8c48be438319 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:23.120037 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1d6a97cf-4120-41d0-a421-8c48be438319 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:23.120532 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1d6a97cf-4120-41d0-a421-8c48be438319 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:23.120968 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1d6a97cf-4120-41d0-a421-8c48be438319 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:23.121646 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1d6a97cf-4120-41d0-a421-8c48be438319 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:23.122093 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1d6a97cf-4120-41d0-a421-8c48be438319 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:23.122514 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1d6a97cf-4120-41d0-a421-8c48be438319 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:23.258518 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-98814cda-a3e3-4bbd-a03d-20dfcdbcedd2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:23.259128 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-98814cda-a3e3-4bbd-a03d-20dfcdbcedd2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:23.260471 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1d6a97cf-4120-41d0-a421-8c48be438319 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:23.265152 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98814cda-a3e3-4bbd-a03d-20dfcdbcedd2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:23.265631 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98814cda-a3e3-4bbd-a03d-20dfcdbcedd2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:23.266069 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98814cda-a3e3-4bbd-a03d-20dfcdbcedd2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:23.266764 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98814cda-a3e3-4bbd-a03d-20dfcdbcedd2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:23.267220 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98814cda-a3e3-4bbd-a03d-20dfcdbcedd2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:23.267643 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98814cda-a3e3-4bbd-a03d-20dfcdbcedd2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:23.269808 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1d6a97cf-4120-41d0-a421-8c48be438319 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.160061 Aug 31 11:46:23.294196 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 236/471] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:23 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:23.407373 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-98814cda-a3e3-4bbd-a03d-20dfcdbcedd2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:23.415526 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-98814cda-a3e3-4bbd-a03d-20dfcdbcedd2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.161564 Aug 31 11:46:23.416094 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 236/472] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:23 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:23.667091 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-91cd01a5-3226-4f18-b085-34528800661b tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:23.667650 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-91cd01a5-3226-4f18-b085-34528800661b tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:23.674133 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91cd01a5-3226-4f18-b085-34528800661b tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:23.674615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91cd01a5-3226-4f18-b085-34528800661b tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:23.675051 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91cd01a5-3226-4f18-b085-34528800661b tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:23.675756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91cd01a5-3226-4f18-b085-34528800661b tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:23.676207 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91cd01a5-3226-4f18-b085-34528800661b tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:23.676657 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91cd01a5-3226-4f18-b085-34528800661b tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:23.745822 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-91cd01a5-3226-4f18-b085-34528800661b tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:23.753713 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-91cd01a5-3226-4f18-b085-34528800661b tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1218 microversion: 2.1 time: 0.090653 Aug 31 11:46:23.754282 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 237/473] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:23 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:24.016542 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-98456cf3-ba85-4cdc-8236-6699626e7b01 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:24.017285 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-98456cf3-ba85-4cdc-8236-6699626e7b01 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:24.019195 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=4 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:24.019851 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=18 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:24.027300 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98456cf3-ba85-4cdc-8236-6699626e7b01 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:24.027793 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98456cf3-ba85-4cdc-8236-6699626e7b01 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:24.028230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98456cf3-ba85-4cdc-8236-6699626e7b01 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:24.028957 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98456cf3-ba85-4cdc-8236-6699626e7b01 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:24.029411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98456cf3-ba85-4cdc-8236-6699626e7b01 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:24.029846 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98456cf3-ba85-4cdc-8236-6699626e7b01 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:24.165072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-98456cf3-ba85-4cdc-8236-6699626e7b01 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:24.172896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-98456cf3-ba85-4cdc-8236-6699626e7b01 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.160235 Aug 31 11:46:24.173697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 237/474] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:24 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:24.301308 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b528674b-7cb6-4c01-a593-3aca28c3ee55 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:24.302438 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b528674b-7cb6-4c01-a593-3aca28c3ee55 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:24.308571 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b528674b-7cb6-4c01-a593-3aca28c3ee55 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:24.309054 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b528674b-7cb6-4c01-a593-3aca28c3ee55 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:24.309483 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b528674b-7cb6-4c01-a593-3aca28c3ee55 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:24.310197 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b528674b-7cb6-4c01-a593-3aca28c3ee55 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:24.310795 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b528674b-7cb6-4c01-a593-3aca28c3ee55 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:24.311173 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b528674b-7cb6-4c01-a593-3aca28c3ee55 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:24.438030 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-938ce832-81a9-4438-928d-8aadf161c3f4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:24.439093 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-938ce832-81a9-4438-928d-8aadf161c3f4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:24.446141 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-938ce832-81a9-4438-928d-8aadf161c3f4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:24.446711 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-938ce832-81a9-4438-928d-8aadf161c3f4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:24.447166 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-938ce832-81a9-4438-928d-8aadf161c3f4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:24.447955 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-938ce832-81a9-4438-928d-8aadf161c3f4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:24.448724 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-938ce832-81a9-4438-928d-8aadf161c3f4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:24.449205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b528674b-7cb6-4c01-a593-3aca28c3ee55 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:24.449335 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-938ce832-81a9-4438-928d-8aadf161c3f4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:24.457886 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b528674b-7cb6-4c01-a593-3aca28c3ee55 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.160506 Aug 31 11:46:24.468544 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 238/475] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:24 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:24.584035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-938ce832-81a9-4438-928d-8aadf161c3f4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:24.591763 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-938ce832-81a9-4438-928d-8aadf161c3f4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.158032 Aug 31 11:46:24.592334 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 238/476] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:24 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:24.776401 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5bf48ba8-3ec4-41fd-a266-c6a9932409da tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:24.777057 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5bf48ba8-3ec4-41fd-a266-c6a9932409da tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:24.783603 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5bf48ba8-3ec4-41fd-a266-c6a9932409da tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:24.784069 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5bf48ba8-3ec4-41fd-a266-c6a9932409da tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:24.784553 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5bf48ba8-3ec4-41fd-a266-c6a9932409da tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:24.785224 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5bf48ba8-3ec4-41fd-a266-c6a9932409da tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:24.785674 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5bf48ba8-3ec4-41fd-a266-c6a9932409da tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:24.786102 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5bf48ba8-3ec4-41fd-a266-c6a9932409da tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:24.851086 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5bf48ba8-3ec4-41fd-a266-c6a9932409da tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:24.859226 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5bf48ba8-3ec4-41fd-a266-c6a9932409da tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1218 microversion: 2.1 time: 0.086590 Aug 31 11:46:24.859788 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 239/477] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:24 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:25.201059 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f18861f7-afe7-40f6-be35-a4ee3f89397b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:25.202825 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f18861f7-afe7-40f6-be35-a4ee3f89397b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:25.209531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f18861f7-afe7-40f6-be35-a4ee3f89397b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:25.210005 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f18861f7-afe7-40f6-be35-a4ee3f89397b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:25.210648 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f18861f7-afe7-40f6-be35-a4ee3f89397b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:25.211157 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f18861f7-afe7-40f6-be35-a4ee3f89397b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:25.211598 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f18861f7-afe7-40f6-be35-a4ee3f89397b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:25.212010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f18861f7-afe7-40f6-be35-a4ee3f89397b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:25.378376 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f18861f7-afe7-40f6-be35-a4ee3f89397b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:25.386956 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f18861f7-afe7-40f6-be35-a4ee3f89397b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.189646 Aug 31 11:46:25.387531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 239/478] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:25 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:25.480597 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-501c4910-a356-4647-803f-d26d6efa6e1e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:25.481710 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-501c4910-a356-4647-803f-d26d6efa6e1e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:25.489139 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-501c4910-a356-4647-803f-d26d6efa6e1e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:25.490365 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-501c4910-a356-4647-803f-d26d6efa6e1e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:25.490801 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-501c4910-a356-4647-803f-d26d6efa6e1e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:25.491492 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-501c4910-a356-4647-803f-d26d6efa6e1e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:25.491941 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-501c4910-a356-4647-803f-d26d6efa6e1e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:25.492372 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-501c4910-a356-4647-803f-d26d6efa6e1e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:25.617087 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ae9c9c9d-ed4a-4c31-a923-ec210123015c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:25.617783 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ae9c9c9d-ed4a-4c31-a923-ec210123015c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:25.629342 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ae9c9c9d-ed4a-4c31-a923-ec210123015c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:25.629943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ae9c9c9d-ed4a-4c31-a923-ec210123015c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:25.630822 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ae9c9c9d-ed4a-4c31-a923-ec210123015c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:25.631631 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ae9c9c9d-ed4a-4c31-a923-ec210123015c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:25.632093 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ae9c9c9d-ed4a-4c31-a923-ec210123015c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:25.635028 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ae9c9c9d-ed4a-4c31-a923-ec210123015c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:25.662288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-501c4910-a356-4647-803f-d26d6efa6e1e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:25.677843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-501c4910-a356-4647-803f-d26d6efa6e1e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.201447 Aug 31 11:46:25.678756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 240/479] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:25 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:25.789354 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ae9c9c9d-ed4a-4c31-a923-ec210123015c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:25.798637 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ae9c9c9d-ed4a-4c31-a923-ec210123015c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.187881 Aug 31 11:46:25.799350 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 240/480] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:25 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:25.882048 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7458a225-dfca-48d4-85d9-341c2e59b90c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:25.882745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7458a225-dfca-48d4-85d9-341c2e59b90c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:25.889475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7458a225-dfca-48d4-85d9-341c2e59b90c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:25.889954 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7458a225-dfca-48d4-85d9-341c2e59b90c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:25.890384 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7458a225-dfca-48d4-85d9-341c2e59b90c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:25.891071 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7458a225-dfca-48d4-85d9-341c2e59b90c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:25.891515 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7458a225-dfca-48d4-85d9-341c2e59b90c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:25.891934 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7458a225-dfca-48d4-85d9-341c2e59b90c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:25.953982 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7458a225-dfca-48d4-85d9-341c2e59b90c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:25.962411 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7458a225-dfca-48d4-85d9-341c2e59b90c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1218 microversion: 2.1 time: 0.084173 Aug 31 11:46:25.962982 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 241/481] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:25 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:26.408783 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f80b1460-ccf7-4f34-aea8-43faf653d82f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:26.409388 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f80b1460-ccf7-4f34-aea8-43faf653d82f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:26.416226 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f80b1460-ccf7-4f34-aea8-43faf653d82f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:26.416753 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f80b1460-ccf7-4f34-aea8-43faf653d82f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:26.417192 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f80b1460-ccf7-4f34-aea8-43faf653d82f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:26.417894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f80b1460-ccf7-4f34-aea8-43faf653d82f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:26.418346 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f80b1460-ccf7-4f34-aea8-43faf653d82f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:26.418772 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f80b1460-ccf7-4f34-aea8-43faf653d82f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:26.559344 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f80b1460-ccf7-4f34-aea8-43faf653d82f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:26.569265 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f80b1460-ccf7-4f34-aea8-43faf653d82f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.163990 Aug 31 11:46:26.569851 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 241/482] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:26 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:26.700166 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1599d0ec-1527-49b5-8f6b-ad10755ee51a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:26.700871 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1599d0ec-1527-49b5-8f6b-ad10755ee51a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:26.712018 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1599d0ec-1527-49b5-8f6b-ad10755ee51a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:26.712532 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1599d0ec-1527-49b5-8f6b-ad10755ee51a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:26.712979 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1599d0ec-1527-49b5-8f6b-ad10755ee51a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:26.713682 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1599d0ec-1527-49b5-8f6b-ad10755ee51a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:26.714193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1599d0ec-1527-49b5-8f6b-ad10755ee51a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:26.714614 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1599d0ec-1527-49b5-8f6b-ad10755ee51a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:26.828274 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-18e3c686-0523-4118-a6f9-34858b26e290 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:26.829115 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-18e3c686-0523-4118-a6f9-34858b26e290 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:26.839706 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-18e3c686-0523-4118-a6f9-34858b26e290 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:26.839706 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-18e3c686-0523-4118-a6f9-34858b26e290 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:26.840073 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-18e3c686-0523-4118-a6f9-34858b26e290 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:26.841615 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-18e3c686-0523-4118-a6f9-34858b26e290 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:26.842336 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-18e3c686-0523-4118-a6f9-34858b26e290 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:26.843169 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-18e3c686-0523-4118-a6f9-34858b26e290 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:26.858375 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1599d0ec-1527-49b5-8f6b-ad10755ee51a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:26.868749 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1599d0ec-1527-49b5-8f6b-ad10755ee51a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.172636 Aug 31 11:46:26.882227 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 242/483] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:26 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:26.983054 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fbcf12f8-fda5-429c-9d9e-95fc05753002 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:26.983668 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fbcf12f8-fda5-429c-9d9e-95fc05753002 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:26.986148 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:26.991903 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fbcf12f8-fda5-429c-9d9e-95fc05753002 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:26.992720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fbcf12f8-fda5-429c-9d9e-95fc05753002 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:26.993165 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fbcf12f8-fda5-429c-9d9e-95fc05753002 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:26.993878 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fbcf12f8-fda5-429c-9d9e-95fc05753002 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:26.994707 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fbcf12f8-fda5-429c-9d9e-95fc05753002 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:26.995140 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fbcf12f8-fda5-429c-9d9e-95fc05753002 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:26.997144 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-18e3c686-0523-4118-a6f9-34858b26e290 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:27.007088 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-18e3c686-0523-4118-a6f9-34858b26e290 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.184007 Aug 31 11:46:27.007969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 242/484] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:26 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:27.093171 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-fbcf12f8-fda5-429c-9d9e-95fc05753002 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:27.101818 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-fbcf12f8-fda5-429c-9d9e-95fc05753002 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1218 microversion: 2.1 time: 0.122566 Aug 31 11:46:27.102390 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 243/485] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:26 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:27.590325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ad3892b3-5128-43aa-824b-a3de4bc5429a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:27.591163 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ad3892b3-5128-43aa-824b-a3de4bc5429a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:27.597308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ad3892b3-5128-43aa-824b-a3de4bc5429a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:27.597956 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ad3892b3-5128-43aa-824b-a3de4bc5429a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:27.598472 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ad3892b3-5128-43aa-824b-a3de4bc5429a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:27.599235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ad3892b3-5128-43aa-824b-a3de4bc5429a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:27.599753 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ad3892b3-5128-43aa-824b-a3de4bc5429a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:27.600243 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ad3892b3-5128-43aa-824b-a3de4bc5429a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:27.742744 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ad3892b3-5128-43aa-824b-a3de4bc5429a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:27.750381 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ad3892b3-5128-43aa-824b-a3de4bc5429a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.163896 Aug 31 11:46:27.750946 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 243/486] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:27 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:27.889450 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6ee54d31-c7ea-4047-a029-f353ea22996c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:27.890173 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6ee54d31-c7ea-4047-a029-f353ea22996c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:27.892037 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=22 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:27.898016 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ee54d31-c7ea-4047-a029-f353ea22996c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:27.898500 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ee54d31-c7ea-4047-a029-f353ea22996c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:27.898926 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ee54d31-c7ea-4047-a029-f353ea22996c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:27.899777 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ee54d31-c7ea-4047-a029-f353ea22996c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:27.900309 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ee54d31-c7ea-4047-a029-f353ea22996c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:27.900756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ee54d31-c7ea-4047-a029-f353ea22996c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:28.027810 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-640c5cba-20fa-4f45-ba61-1fcaf3a5db6b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:28.028328 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-640c5cba-20fa-4f45-ba61-1fcaf3a5db6b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:28.033264 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6ee54d31-c7ea-4047-a029-f353ea22996c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:28.034576 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-640c5cba-20fa-4f45-ba61-1fcaf3a5db6b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:28.035059 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-640c5cba-20fa-4f45-ba61-1fcaf3a5db6b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:28.035492 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-640c5cba-20fa-4f45-ba61-1fcaf3a5db6b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:28.036245 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-640c5cba-20fa-4f45-ba61-1fcaf3a5db6b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:28.037233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-640c5cba-20fa-4f45-ba61-1fcaf3a5db6b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:28.037809 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-640c5cba-20fa-4f45-ba61-1fcaf3a5db6b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:28.041500 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6ee54d31-c7ea-4047-a029-f353ea22996c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.155876 Aug 31 11:46:28.042068 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 244/487] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:27 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:28.123709 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2409e984-fa5a-4c8d-aacd-e88c584ea8c9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:28.124340 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2409e984-fa5a-4c8d-aacd-e88c584ea8c9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:28.130386 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2409e984-fa5a-4c8d-aacd-e88c584ea8c9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:28.130858 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2409e984-fa5a-4c8d-aacd-e88c584ea8c9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:28.131278 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2409e984-fa5a-4c8d-aacd-e88c584ea8c9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:28.131957 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2409e984-fa5a-4c8d-aacd-e88c584ea8c9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:28.132397 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2409e984-fa5a-4c8d-aacd-e88c584ea8c9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:28.132843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2409e984-fa5a-4c8d-aacd-e88c584ea8c9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:28.174527 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-640c5cba-20fa-4f45-ba61-1fcaf3a5db6b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:28.182345 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-640c5cba-20fa-4f45-ba61-1fcaf3a5db6b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.158399 Aug 31 11:46:28.183954 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 244/488] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:28 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:28.195600 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2409e984-fa5a-4c8d-aacd-e88c584ea8c9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:28.203145 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2409e984-fa5a-4c8d-aacd-e88c584ea8c9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1218 microversion: 2.1 time: 0.083320 Aug 31 11:46:28.204074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 245/489] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:28 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:28.773079 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-75200847-0086-4e22-aa14-e26df38cc578 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:28.773699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-75200847-0086-4e22-aa14-e26df38cc578 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:28.779669 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-75200847-0086-4e22-aa14-e26df38cc578 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:28.780153 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-75200847-0086-4e22-aa14-e26df38cc578 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:28.780610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-75200847-0086-4e22-aa14-e26df38cc578 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:28.781301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-75200847-0086-4e22-aa14-e26df38cc578 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:28.781752 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-75200847-0086-4e22-aa14-e26df38cc578 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:28.782177 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-75200847-0086-4e22-aa14-e26df38cc578 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:28.913420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-75200847-0086-4e22-aa14-e26df38cc578 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:28.921079 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-75200847-0086-4e22-aa14-e26df38cc578 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.152842 Aug 31 11:46:28.921639 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 245/490] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:28 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:29.063661 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6525b2d2-4c59-4e50-a075-ac19cfae83ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:29.064261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6525b2d2-4c59-4e50-a075-ac19cfae83ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:29.071020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6525b2d2-4c59-4e50-a075-ac19cfae83ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:29.071490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6525b2d2-4c59-4e50-a075-ac19cfae83ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:29.071914 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6525b2d2-4c59-4e50-a075-ac19cfae83ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:29.072616 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6525b2d2-4c59-4e50-a075-ac19cfae83ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:29.073132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6525b2d2-4c59-4e50-a075-ac19cfae83ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:29.073569 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6525b2d2-4c59-4e50-a075-ac19cfae83ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:29.203310 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3aa6f3bf-84f7-4f3e-b734-436883134600 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:29.203902 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3aa6f3bf-84f7-4f3e-b734-436883134600 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:29.205614 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6525b2d2-4c59-4e50-a075-ac19cfae83ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:29.210405 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3aa6f3bf-84f7-4f3e-b734-436883134600 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:29.210880 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3aa6f3bf-84f7-4f3e-b734-436883134600 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:29.211306 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3aa6f3bf-84f7-4f3e-b734-436883134600 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:29.211987 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3aa6f3bf-84f7-4f3e-b734-436883134600 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:29.212421 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3aa6f3bf-84f7-4f3e-b734-436883134600 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:29.212871 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3aa6f3bf-84f7-4f3e-b734-436883134600 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:29.219490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6525b2d2-4c59-4e50-a075-ac19cfae83ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.159470 Aug 31 11:46:29.220320 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 246/491] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:29 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:29.226528 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9086f5ed-d3fb-4f4d-9ea0-d4dc3e70f37f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:29.227131 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9086f5ed-d3fb-4f4d-9ea0-d4dc3e70f37f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:29.233096 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9086f5ed-d3fb-4f4d-9ea0-d4dc3e70f37f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:29.233585 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9086f5ed-d3fb-4f4d-9ea0-d4dc3e70f37f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:29.234019 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9086f5ed-d3fb-4f4d-9ea0-d4dc3e70f37f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:29.234700 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9086f5ed-d3fb-4f4d-9ea0-d4dc3e70f37f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:29.235147 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9086f5ed-d3fb-4f4d-9ea0-d4dc3e70f37f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:29.235569 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9086f5ed-d3fb-4f4d-9ea0-d4dc3e70f37f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:29.299259 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9086f5ed-d3fb-4f4d-9ea0-d4dc3e70f37f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:29.308345 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9086f5ed-d3fb-4f4d-9ea0-d4dc3e70f37f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1218 microversion: 2.1 time: 0.086287 Aug 31 11:46:29.308944 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 247/492] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:29 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:29.345757 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3aa6f3bf-84f7-4f3e-b734-436883134600 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:29.353737 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3aa6f3bf-84f7-4f3e-b734-436883134600 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.154121 Aug 31 11:46:29.354293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 246/493] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:29 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:29.942067 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-dc4b766e-0f7d-4709-99d5-d20e118cc2f8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:29.943341 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-dc4b766e-0f7d-4709-99d5-d20e118cc2f8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:29.949293 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dc4b766e-0f7d-4709-99d5-d20e118cc2f8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:29.949770 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dc4b766e-0f7d-4709-99d5-d20e118cc2f8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:29.950229 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dc4b766e-0f7d-4709-99d5-d20e118cc2f8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:29.950931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dc4b766e-0f7d-4709-99d5-d20e118cc2f8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:29.951376 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dc4b766e-0f7d-4709-99d5-d20e118cc2f8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:29.951800 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dc4b766e-0f7d-4709-99d5-d20e118cc2f8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:30.077104 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-dc4b766e-0f7d-4709-99d5-d20e118cc2f8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:30.084720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-dc4b766e-0f7d-4709-99d5-d20e118cc2f8 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.146880 Aug 31 11:46:30.085279 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 248/494] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:29 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:30.242873 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-68c9455b-47c1-4fa1-9651-ff9c28f00ef1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:30.243477 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-68c9455b-47c1-4fa1-9651-ff9c28f00ef1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:30.249531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-68c9455b-47c1-4fa1-9651-ff9c28f00ef1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:30.250014 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-68c9455b-47c1-4fa1-9651-ff9c28f00ef1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:30.250448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-68c9455b-47c1-4fa1-9651-ff9c28f00ef1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:30.251163 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-68c9455b-47c1-4fa1-9651-ff9c28f00ef1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:30.251611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-68c9455b-47c1-4fa1-9651-ff9c28f00ef1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:30.252035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-68c9455b-47c1-4fa1-9651-ff9c28f00ef1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:30.329386 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-964d0aa8-6ab0-4613-8497-b6c6278203c5 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:30.330103 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-964d0aa8-6ab0-4613-8497-b6c6278203c5 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:30.336347 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-964d0aa8-6ab0-4613-8497-b6c6278203c5 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:30.336927 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-964d0aa8-6ab0-4613-8497-b6c6278203c5 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:30.337428 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-964d0aa8-6ab0-4613-8497-b6c6278203c5 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:30.338179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-964d0aa8-6ab0-4613-8497-b6c6278203c5 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:30.338701 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-964d0aa8-6ab0-4613-8497-b6c6278203c5 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:30.339201 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-964d0aa8-6ab0-4613-8497-b6c6278203c5 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:30.389664 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-68c9455b-47c1-4fa1-9651-ff9c28f00ef1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:30.397497 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-68c9455b-47c1-4fa1-9651-ff9c28f00ef1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.160033 Aug 31 11:46:30.398268 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 247/495] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:30 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:30.402809 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-964d0aa8-6ab0-4613-8497-b6c6278203c5 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:30.403758 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3d992a74-fb28-44f8-8733-ee7c4de02593 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:30.404361 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3d992a74-fb28-44f8-8733-ee7c4de02593 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:30.410457 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-964d0aa8-6ab0-4613-8497-b6c6278203c5 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1218 microversion: 2.1 time: 0.084928 Aug 31 11:46:30.410611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3d992a74-fb28-44f8-8733-ee7c4de02593 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:30.410935 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3d992a74-fb28-44f8-8733-ee7c4de02593 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:30.411842 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 249/496] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:30 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:30.416230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3d992a74-fb28-44f8-8733-ee7c4de02593 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:30.416983 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3d992a74-fb28-44f8-8733-ee7c4de02593 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:30.417450 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3d992a74-fb28-44f8-8733-ee7c4de02593 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:30.417877 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3d992a74-fb28-44f8-8733-ee7c4de02593 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:30.545091 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3d992a74-fb28-44f8-8733-ee7c4de02593 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:30.553205 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3d992a74-fb28-44f8-8733-ee7c4de02593 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.154140 Aug 31 11:46:30.553761 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 248/497] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:30 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:31.105885 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-615cac3f-eac6-400d-840c-4a61ff99c55c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:31.106493 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-615cac3f-eac6-400d-840c-4a61ff99c55c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:31.112924 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-615cac3f-eac6-400d-840c-4a61ff99c55c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:31.113401 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-615cac3f-eac6-400d-840c-4a61ff99c55c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:31.113830 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-615cac3f-eac6-400d-840c-4a61ff99c55c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:31.114537 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-615cac3f-eac6-400d-840c-4a61ff99c55c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:31.114984 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-615cac3f-eac6-400d-840c-4a61ff99c55c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:31.115405 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-615cac3f-eac6-400d-840c-4a61ff99c55c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:31.252543 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-615cac3f-eac6-400d-840c-4a61ff99c55c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:31.254717 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:31.262073 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-615cac3f-eac6-400d-840c-4a61ff99c55c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.159925 Aug 31 11:46:31.262643 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 250/498] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:31 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:31.420335 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-adc71bec-fcd9-451c-9b87-54a1b1d9a959 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:31.420916 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-adc71bec-fcd9-451c-9b87-54a1b1d9a959 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:31.428039 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-adc71bec-fcd9-451c-9b87-54a1b1d9a959 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:31.428545 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-adc71bec-fcd9-451c-9b87-54a1b1d9a959 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:31.428976 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-adc71bec-fcd9-451c-9b87-54a1b1d9a959 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:31.429879 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-adc71bec-fcd9-451c-9b87-54a1b1d9a959 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:31.430370 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-adc71bec-fcd9-451c-9b87-54a1b1d9a959 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:31.431008 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-adc71bec-fcd9-451c-9b87-54a1b1d9a959 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:31.431230 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-882293d2-525d-4beb-beb5-07e9ce50b3c8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:31.431843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-882293d2-525d-4beb-beb5-07e9ce50b3c8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:31.437894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-882293d2-525d-4beb-beb5-07e9ce50b3c8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:31.438370 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-882293d2-525d-4beb-beb5-07e9ce50b3c8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:31.439577 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-882293d2-525d-4beb-beb5-07e9ce50b3c8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:31.441457 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-882293d2-525d-4beb-beb5-07e9ce50b3c8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:31.441918 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-882293d2-525d-4beb-beb5-07e9ce50b3c8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:31.442853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-882293d2-525d-4beb-beb5-07e9ce50b3c8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:31.502804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-882293d2-525d-4beb-beb5-07e9ce50b3c8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:31.510866 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-882293d2-525d-4beb-beb5-07e9ce50b3c8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1218 microversion: 2.1 time: 0.083421 Aug 31 11:46:31.511437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 251/499] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:31 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:31.564864 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-adc71bec-fcd9-451c-9b87-54a1b1d9a959 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:31.573749 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-adc71bec-fcd9-451c-9b87-54a1b1d9a959 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.157501 Aug 31 11:46:31.574255 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-40849fe1-ab51-401d-a937-a73024eb0283 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:31.574389 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 249/500] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:31 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:31.574865 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-40849fe1-ab51-401d-a937-a73024eb0283 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:31.580665 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40849fe1-ab51-401d-a937-a73024eb0283 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:31.581137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40849fe1-ab51-401d-a937-a73024eb0283 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:31.581562 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40849fe1-ab51-401d-a937-a73024eb0283 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:31.582267 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40849fe1-ab51-401d-a937-a73024eb0283 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:31.582705 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40849fe1-ab51-401d-a937-a73024eb0283 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:31.583242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40849fe1-ab51-401d-a937-a73024eb0283 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:31.715645 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-40849fe1-ab51-401d-a937-a73024eb0283 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:31.723375 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-40849fe1-ab51-401d-a937-a73024eb0283 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1319 microversion: 2.1 time: 0.152938 Aug 31 11:46:31.724087 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 252/501] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:31 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:32.293920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7b7793b1-df27-4854-b461-dfb140c9e931 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:32.295745 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-7b7793b1-df27-4854-b461-dfb140c9e931 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:32.306168 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b7793b1-df27-4854-b461-dfb140c9e931 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:32.306674 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b7793b1-df27-4854-b461-dfb140c9e931 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:32.307113 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b7793b1-df27-4854-b461-dfb140c9e931 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:32.307874 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b7793b1-df27-4854-b461-dfb140c9e931 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:32.308278 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b7793b1-df27-4854-b461-dfb140c9e931 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:32.308766 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b7793b1-df27-4854-b461-dfb140c9e931 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:32.314747 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:32.532898 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8cb79940-5b61-46a2-9d32-6340874b80c7 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:32.533498 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8cb79940-5b61-46a2-9d32-6340874b80c7 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:32.541391 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8cb79940-5b61-46a2-9d32-6340874b80c7 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:32.541888 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8cb79940-5b61-46a2-9d32-6340874b80c7 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:32.542323 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8cb79940-5b61-46a2-9d32-6340874b80c7 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:32.543037 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8cb79940-5b61-46a2-9d32-6340874b80c7 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:32.543482 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8cb79940-5b61-46a2-9d32-6340874b80c7 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:32.543904 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8cb79940-5b61-46a2-9d32-6340874b80c7 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:32.610274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8cb79940-5b61-46a2-9d32-6340874b80c7 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:32.618895 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8cb79940-5b61-46a2-9d32-6340874b80c7 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1218 microversion: 2.1 time: 0.090065 Aug 31 11:46:32.619473 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 253/502] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:32 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:32.624149 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fa056152-8d7b-4a5e-8b36-ea1729a777ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:32.624784 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fa056152-8d7b-4a5e-8b36-ea1729a777ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:32.631501 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa056152-8d7b-4a5e-8b36-ea1729a777ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:32.631983 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa056152-8d7b-4a5e-8b36-ea1729a777ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:32.632413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa056152-8d7b-4a5e-8b36-ea1729a777ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:32.633132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa056152-8d7b-4a5e-8b36-ea1729a777ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:32.633578 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa056152-8d7b-4a5e-8b36-ea1729a777ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:32.633996 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa056152-8d7b-4a5e-8b36-ea1729a777ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:32.758189 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7b7793b1-df27-4854-b461-dfb140c9e931 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:32.766534 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-7b7793b1-df27-4854-b461-dfb140c9e931 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.485151 Aug 31 11:46:32.767124 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 250/503] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:32 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:32.770738 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-fa056152-8d7b-4a5e-8b36-ea1729a777ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:32.772180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-46666a9c-cfb7-4b2c-8a09-3ec523368d5a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:32.772805 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-46666a9c-cfb7-4b2c-8a09-3ec523368d5a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:32.780430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-46666a9c-cfb7-4b2c-8a09-3ec523368d5a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:32.780943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-46666a9c-cfb7-4b2c-8a09-3ec523368d5a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:32.781371 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-46666a9c-cfb7-4b2c-8a09-3ec523368d5a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:32.790626 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-fa056152-8d7b-4a5e-8b36-ea1729a777ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.170041 Aug 31 11:46:32.791844 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 254/504] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:32 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:32.792921 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-46666a9c-cfb7-4b2c-8a09-3ec523368d5a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:32.793403 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-46666a9c-cfb7-4b2c-8a09-3ec523368d5a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:32.793851 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-46666a9c-cfb7-4b2c-8a09-3ec523368d5a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:33.092589 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-46666a9c-cfb7-4b2c-8a09-3ec523368d5a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:33.100255 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-46666a9c-cfb7-4b2c-8a09-3ec523368d5a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1507 microversion: 2.1 time: 0.332006 Aug 31 11:46:33.100851 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 251/505] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:32 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:33.616918 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-d5103877-4e10-4a97-aef2-3d7410ca56c5 req-da67bb14-9a2b-4e9f-baf7-f162af7e52b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30732ac7-790c-4585-9d27-a723b4a49095", "tag": "008c8ca4-7cac-42b6-9966-a441e62ec36a"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:33.627085 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-d5103877-4e10-4a97-aef2-3d7410ca56c5 req-da67bb14-9a2b-4e9f-baf7-f162af7e52b1 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:33.627930 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-d5103877-4e10-4a97-aef2-3d7410ca56c5 req-da67bb14-9a2b-4e9f-baf7-f162af7e52b1 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:33.628223 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-d5103877-4e10-4a97-aef2-3d7410ca56c5 req-da67bb14-9a2b-4e9f-baf7-f162af7e52b1 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:33.640880 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6d17a87c-e15e-43cb-a9a5-a65182727e48 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:33.641164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-d5103877-4e10-4a97-aef2-3d7410ca56c5 req-da67bb14-9a2b-4e9f-baf7-f162af7e52b1 service nova] Creating event network-changed:008c8ca4-7cac-42b6-9966-a441e62ec36a for instance 30732ac7-790c-4585-9d27-a723b4a49095 on hv-cinder-83976 Aug 31 11:46:33.641566 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6d17a87c-e15e-43cb-a9a5-a65182727e48 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:33.648085 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-d5103877-4e10-4a97-aef2-3d7410ca56c5 req-da67bb14-9a2b-4e9f-baf7-f162af7e52b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034111 Aug 31 11:46:33.648831 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d17a87c-e15e-43cb-a9a5-a65182727e48 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:33.648962 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 255/506] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:46:33.649395 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d17a87c-e15e-43cb-a9a5-a65182727e48 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:33.649832 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d17a87c-e15e-43cb-a9a5-a65182727e48 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:33.650531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d17a87c-e15e-43cb-a9a5-a65182727e48 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:33.651078 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d17a87c-e15e-43cb-a9a5-a65182727e48 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:33.651498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d17a87c-e15e-43cb-a9a5-a65182727e48 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:33.719707 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6d17a87c-e15e-43cb-a9a5-a65182727e48 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:33.727939 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6d17a87c-e15e-43cb-a9a5-a65182727e48 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1266 microversion: 2.1 time: 0.090789 Aug 31 11:46:33.728732 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 252/507] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:33 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:33.787671 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-478aaade-fd89-4834-95ec-932982ac214c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:33.788358 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-478aaade-fd89-4834-95ec-932982ac214c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:33.794559 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-478aaade-fd89-4834-95ec-932982ac214c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:33.795119 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-478aaade-fd89-4834-95ec-932982ac214c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:33.795559 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-478aaade-fd89-4834-95ec-932982ac214c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:33.796247 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-478aaade-fd89-4834-95ec-932982ac214c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:33.796726 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-478aaade-fd89-4834-95ec-932982ac214c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:33.797223 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-478aaade-fd89-4834-95ec-932982ac214c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:33.813489 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-21c16e71-75e9-40a2-ace6-a961c95e8f48 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:33.814198 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-21c16e71-75e9-40a2-ace6-a961c95e8f48 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:33.821561 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21c16e71-75e9-40a2-ace6-a961c95e8f48 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:33.822048 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21c16e71-75e9-40a2-ace6-a961c95e8f48 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:33.822475 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21c16e71-75e9-40a2-ace6-a961c95e8f48 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:33.823160 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21c16e71-75e9-40a2-ace6-a961c95e8f48 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:33.823714 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21c16e71-75e9-40a2-ace6-a961c95e8f48 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:33.824177 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21c16e71-75e9-40a2-ace6-a961c95e8f48 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:33.968991 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-21c16e71-75e9-40a2-ace6-a961c95e8f48 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:33.980937 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-21c16e71-75e9-40a2-ace6-a961c95e8f48 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.171358 Aug 31 11:46:33.982010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 253/508] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:33 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:34.214468 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-478aaade-fd89-4834-95ec-932982ac214c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:34.222255 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-478aaade-fd89-4834-95ec-932982ac214c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.438888 Aug 31 11:46:34.222810 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 256/509] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:33 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:34.750328 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2f12ccd3-be5e-489b-a2c2-a02cc8db194e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:34.750926 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2f12ccd3-be5e-489b-a2c2-a02cc8db194e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:34.761725 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2f12ccd3-be5e-489b-a2c2-a02cc8db194e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:34.761943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2f12ccd3-be5e-489b-a2c2-a02cc8db194e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:34.762217 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2f12ccd3-be5e-489b-a2c2-a02cc8db194e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:34.762937 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2f12ccd3-be5e-489b-a2c2-a02cc8db194e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:34.763400 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2f12ccd3-be5e-489b-a2c2-a02cc8db194e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:34.763828 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2f12ccd3-be5e-489b-a2c2-a02cc8db194e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:34.838470 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2f12ccd3-be5e-489b-a2c2-a02cc8db194e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:34.847614 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2f12ccd3-be5e-489b-a2c2-a02cc8db194e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1274 microversion: 2.1 time: 0.101007 Aug 31 11:46:34.848268 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 254/510] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:34 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:35.003153 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ac1e2f33-7e99-4598-b6a7-a177ed358be9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:35.003711 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ac1e2f33-7e99-4598-b6a7-a177ed358be9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:35.010199 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac1e2f33-7e99-4598-b6a7-a177ed358be9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:35.010656 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac1e2f33-7e99-4598-b6a7-a177ed358be9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:35.011085 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac1e2f33-7e99-4598-b6a7-a177ed358be9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:35.011759 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac1e2f33-7e99-4598-b6a7-a177ed358be9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:35.012202 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac1e2f33-7e99-4598-b6a7-a177ed358be9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:35.012646 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ac1e2f33-7e99-4598-b6a7-a177ed358be9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:35.166376 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ac1e2f33-7e99-4598-b6a7-a177ed358be9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:35.174593 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ac1e2f33-7e99-4598-b6a7-a177ed358be9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.175611 Aug 31 11:46:35.175225 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 257/511] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:34 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:35.246360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a3c8a388-d91a-4953-80f2-bd1925d17d16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:35.246961 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a3c8a388-d91a-4953-80f2-bd1925d17d16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:35.255026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a3c8a388-d91a-4953-80f2-bd1925d17d16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:35.255874 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a3c8a388-d91a-4953-80f2-bd1925d17d16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:35.256674 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a3c8a388-d91a-4953-80f2-bd1925d17d16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:35.257445 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a3c8a388-d91a-4953-80f2-bd1925d17d16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:35.258040 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a3c8a388-d91a-4953-80f2-bd1925d17d16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:35.258481 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a3c8a388-d91a-4953-80f2-bd1925d17d16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:35.426671 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a3c8a388-d91a-4953-80f2-bd1925d17d16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:35.435271 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a3c8a388-d91a-4953-80f2-bd1925d17d16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.193895 Aug 31 11:46:35.435844 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 255/512] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:35 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:35.882401 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-13554109-37d6-4097-95b0-b17bf8518705 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:35.883038 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-13554109-37d6-4097-95b0-b17bf8518705 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:35.889563 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13554109-37d6-4097-95b0-b17bf8518705 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:35.890056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13554109-37d6-4097-95b0-b17bf8518705 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:35.890488 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13554109-37d6-4097-95b0-b17bf8518705 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:35.891193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13554109-37d6-4097-95b0-b17bf8518705 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:35.891666 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13554109-37d6-4097-95b0-b17bf8518705 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:35.892087 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13554109-37d6-4097-95b0-b17bf8518705 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:35.954964 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-13554109-37d6-4097-95b0-b17bf8518705 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:35.963488 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-13554109-37d6-4097-95b0-b17bf8518705 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1274 microversion: 2.1 time: 0.086017 Aug 31 11:46:35.964066 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 258/513] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:35 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:36.196930 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e3c39b5b-8ff6-4b53-86e3-71d49ce43e60 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:36.197559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e3c39b5b-8ff6-4b53-86e3-71d49ce43e60 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:36.203460 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e3c39b5b-8ff6-4b53-86e3-71d49ce43e60 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:36.203886 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e3c39b5b-8ff6-4b53-86e3-71d49ce43e60 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:36.204314 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e3c39b5b-8ff6-4b53-86e3-71d49ce43e60 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:36.205089 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e3c39b5b-8ff6-4b53-86e3-71d49ce43e60 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:36.205537 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e3c39b5b-8ff6-4b53-86e3-71d49ce43e60 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:36.205956 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e3c39b5b-8ff6-4b53-86e3-71d49ce43e60 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:36.340027 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e3c39b5b-8ff6-4b53-86e3-71d49ce43e60 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:36.347523 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e3c39b5b-8ff6-4b53-86e3-71d49ce43e60 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.155133 Aug 31 11:46:36.348083 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 256/514] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:36 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:36.458018 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1592a922-ea30-42d0-90c9-76cddd492d41 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:36.458574 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1592a922-ea30-42d0-90c9-76cddd492d41 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:36.465269 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1592a922-ea30-42d0-90c9-76cddd492d41 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:36.466074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1592a922-ea30-42d0-90c9-76cddd492d41 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:36.466503 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1592a922-ea30-42d0-90c9-76cddd492d41 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:36.467180 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1592a922-ea30-42d0-90c9-76cddd492d41 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:36.467618 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1592a922-ea30-42d0-90c9-76cddd492d41 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:36.468034 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1592a922-ea30-42d0-90c9-76cddd492d41 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:36.601990 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1592a922-ea30-42d0-90c9-76cddd492d41 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:36.609968 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1592a922-ea30-42d0-90c9-76cddd492d41 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.155842 Aug 31 11:46:36.610527 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 259/515] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:36 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:36.984405 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-18c5e4d8-5b65-4551-b0e9-3b7f36505623 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:36.984972 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-18c5e4d8-5b65-4551-b0e9-3b7f36505623 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:36.991098 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-18c5e4d8-5b65-4551-b0e9-3b7f36505623 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:36.991579 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-18c5e4d8-5b65-4551-b0e9-3b7f36505623 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:36.992014 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-18c5e4d8-5b65-4551-b0e9-3b7f36505623 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:36.992733 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-18c5e4d8-5b65-4551-b0e9-3b7f36505623 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:36.993184 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-18c5e4d8-5b65-4551-b0e9-3b7f36505623 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:36.993606 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-18c5e4d8-5b65-4551-b0e9-3b7f36505623 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:37.054815 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-18c5e4d8-5b65-4551-b0e9-3b7f36505623 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:37.062493 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-18c5e4d8-5b65-4551-b0e9-3b7f36505623 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1274 microversion: 2.1 time: 0.082308 Aug 31 11:46:37.063044 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 257/516] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:36 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:37.370367 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d027bda3-857e-449a-ac68-7d772d0cda74 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:37.370983 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d027bda3-857e-449a-ac68-7d772d0cda74 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:37.381329 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d027bda3-857e-449a-ac68-7d772d0cda74 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:37.382076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d027bda3-857e-449a-ac68-7d772d0cda74 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:37.382542 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d027bda3-857e-449a-ac68-7d772d0cda74 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:37.383220 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d027bda3-857e-449a-ac68-7d772d0cda74 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:37.383699 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d027bda3-857e-449a-ac68-7d772d0cda74 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:37.384379 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d027bda3-857e-449a-ac68-7d772d0cda74 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:37.535715 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d027bda3-857e-449a-ac68-7d772d0cda74 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:37.547312 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d027bda3-857e-449a-ac68-7d772d0cda74 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.181528 Aug 31 11:46:37.547997 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 260/517] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:37 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:37.631917 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-196eb677-fd87-45ed-aff1-658d51b5298e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:37.632812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-196eb677-fd87-45ed-aff1-658d51b5298e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:37.643430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-196eb677-fd87-45ed-aff1-658d51b5298e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:37.644099 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-196eb677-fd87-45ed-aff1-658d51b5298e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:37.645501 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-196eb677-fd87-45ed-aff1-658d51b5298e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:37.647827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-196eb677-fd87-45ed-aff1-658d51b5298e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:37.648481 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-196eb677-fd87-45ed-aff1-658d51b5298e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:37.648933 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-196eb677-fd87-45ed-aff1-658d51b5298e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:38.007545 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-196eb677-fd87-45ed-aff1-658d51b5298e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:38.016082 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-196eb677-fd87-45ed-aff1-658d51b5298e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.388361 Aug 31 11:46:38.016692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 258/518] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:37 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:38.084384 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-aa6acb5e-52e6-41b9-8a7f-14c529433193 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:38.085079 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-aa6acb5e-52e6-41b9-8a7f-14c529433193 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:38.091412 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aa6acb5e-52e6-41b9-8a7f-14c529433193 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:38.091898 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aa6acb5e-52e6-41b9-8a7f-14c529433193 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:38.092332 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aa6acb5e-52e6-41b9-8a7f-14c529433193 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:38.093043 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aa6acb5e-52e6-41b9-8a7f-14c529433193 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:38.093494 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aa6acb5e-52e6-41b9-8a7f-14c529433193 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:38.093914 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aa6acb5e-52e6-41b9-8a7f-14c529433193 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:38.165277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-aa6acb5e-52e6-41b9-8a7f-14c529433193 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:38.173589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-aa6acb5e-52e6-41b9-8a7f-14c529433193 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1272 microversion: 2.1 time: 0.094241 Aug 31 11:46:38.174157 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 261/519] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:38 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:38.574088 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5a23787d-450d-4ca5-92c5-aa9451870875 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:38.574749 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5a23787d-450d-4ca5-92c5-aa9451870875 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:38.581148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a23787d-450d-4ca5-92c5-aa9451870875 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:38.581565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a23787d-450d-4ca5-92c5-aa9451870875 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:38.581997 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a23787d-450d-4ca5-92c5-aa9451870875 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:38.582685 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a23787d-450d-4ca5-92c5-aa9451870875 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:38.583152 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a23787d-450d-4ca5-92c5-aa9451870875 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:38.584097 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a23787d-450d-4ca5-92c5-aa9451870875 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:39.037501 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-56213423-6fc0-435e-b669-73b845ac50ce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:39.038200 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-56213423-6fc0-435e-b669-73b845ac50ce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:39.045450 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56213423-6fc0-435e-b669-73b845ac50ce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:39.046054 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56213423-6fc0-435e-b669-73b845ac50ce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:39.046546 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56213423-6fc0-435e-b669-73b845ac50ce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:39.047314 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56213423-6fc0-435e-b669-73b845ac50ce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:39.047981 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56213423-6fc0-435e-b669-73b845ac50ce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:39.048753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56213423-6fc0-435e-b669-73b845ac50ce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:39.145336 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5a23787d-450d-4ca5-92c5-aa9451870875 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:39.161802 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5a23787d-450d-4ca5-92c5-aa9451870875 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.589648 Aug 31 11:46:39.165683 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 259/520] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:38 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:39.196286 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b659ef65-beeb-48b7-ba95-3e9244839092 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:39.197172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b659ef65-beeb-48b7-ba95-3e9244839092 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:39.203230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b659ef65-beeb-48b7-ba95-3e9244839092 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:39.203948 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b659ef65-beeb-48b7-ba95-3e9244839092 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:39.204559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b659ef65-beeb-48b7-ba95-3e9244839092 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:39.205413 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b659ef65-beeb-48b7-ba95-3e9244839092 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:39.206330 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b659ef65-beeb-48b7-ba95-3e9244839092 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:39.206903 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b659ef65-beeb-48b7-ba95-3e9244839092 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:39.247620 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-56213423-6fc0-435e-b669-73b845ac50ce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:39.257229 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-56213423-6fc0-435e-b669-73b845ac50ce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.222191 Aug 31 11:46:39.258072 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 262/521] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:39 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:39.433844 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b659ef65-beeb-48b7-ba95-3e9244839092 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:39.447873 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b659ef65-beeb-48b7-ba95-3e9244839092 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1314 microversion: 2.1 time: 0.256355 Aug 31 11:46:39.448542 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 260/522] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:39 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:40.186582 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4ba76b0e-dc0a-4947-9b60-2153a86bd4a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:40.187163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4ba76b0e-dc0a-4947-9b60-2153a86bd4a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:40.193765 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4ba76b0e-dc0a-4947-9b60-2153a86bd4a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:40.194322 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4ba76b0e-dc0a-4947-9b60-2153a86bd4a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:40.194791 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4ba76b0e-dc0a-4947-9b60-2153a86bd4a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:40.195470 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4ba76b0e-dc0a-4947-9b60-2153a86bd4a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:40.195950 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4ba76b0e-dc0a-4947-9b60-2153a86bd4a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:40.196393 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4ba76b0e-dc0a-4947-9b60-2153a86bd4a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:40.278467 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-63a96e31-8206-433e-bfbd-36a16067627d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:40.279085 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-63a96e31-8206-433e-bfbd-36a16067627d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:40.285158 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63a96e31-8206-433e-bfbd-36a16067627d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:40.285653 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63a96e31-8206-433e-bfbd-36a16067627d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:40.286091 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63a96e31-8206-433e-bfbd-36a16067627d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:40.287350 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63a96e31-8206-433e-bfbd-36a16067627d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:40.287811 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63a96e31-8206-433e-bfbd-36a16067627d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:40.288239 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63a96e31-8206-433e-bfbd-36a16067627d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:40.332167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4ba76b0e-dc0a-4947-9b60-2153a86bd4a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:40.349691 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4ba76b0e-dc0a-4947-9b60-2153a86bd4a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.166290 Aug 31 11:46:40.350449 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 263/523] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:40 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:40.427984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-63a96e31-8206-433e-bfbd-36a16067627d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:40.435798 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-63a96e31-8206-433e-bfbd-36a16067627d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.161590 Aug 31 11:46:40.436369 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 261/524] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:40 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:40.470330 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-89d8aab6-a8b2-43ac-bc88-e05d05da4f0d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:40.470852 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-89d8aab6-a8b2-43ac-bc88-e05d05da4f0d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:40.479230 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-89d8aab6-a8b2-43ac-bc88-e05d05da4f0d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:40.479709 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-89d8aab6-a8b2-43ac-bc88-e05d05da4f0d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:40.480200 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-89d8aab6-a8b2-43ac-bc88-e05d05da4f0d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:40.480918 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-89d8aab6-a8b2-43ac-bc88-e05d05da4f0d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:40.481368 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-89d8aab6-a8b2-43ac-bc88-e05d05da4f0d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:40.481791 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-89d8aab6-a8b2-43ac-bc88-e05d05da4f0d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:40.614751 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-89d8aab6-a8b2-43ac-bc88-e05d05da4f0d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:40.623310 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-89d8aab6-a8b2-43ac-bc88-e05d05da4f0d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1314 microversion: 2.1 time: 0.158017 Aug 31 11:46:40.623885 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 264/525] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:40 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:41.370761 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7e781887-7a14-4834-9b8e-14452c6cbcd7 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:41.371361 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-7e781887-7a14-4834-9b8e-14452c6cbcd7 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:41.377697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e781887-7a14-4834-9b8e-14452c6cbcd7 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:41.378195 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e781887-7a14-4834-9b8e-14452c6cbcd7 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:41.378637 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e781887-7a14-4834-9b8e-14452c6cbcd7 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:41.379341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e781887-7a14-4834-9b8e-14452c6cbcd7 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:41.379788 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e781887-7a14-4834-9b8e-14452c6cbcd7 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:41.380211 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e781887-7a14-4834-9b8e-14452c6cbcd7 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:41.457366 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6f2fb504-cd1f-4a82-b704-4d9352c68a5d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:41.457997 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6f2fb504-cd1f-4a82-b704-4d9352c68a5d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:41.468164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6f2fb504-cd1f-4a82-b704-4d9352c68a5d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:41.468164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6f2fb504-cd1f-4a82-b704-4d9352c68a5d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:41.468164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6f2fb504-cd1f-4a82-b704-4d9352c68a5d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:41.468954 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6f2fb504-cd1f-4a82-b704-4d9352c68a5d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:41.469414 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6f2fb504-cd1f-4a82-b704-4d9352c68a5d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:41.469836 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6f2fb504-cd1f-4a82-b704-4d9352c68a5d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:41.541783 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7e781887-7a14-4834-9b8e-14452c6cbcd7 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:41.550012 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-7e781887-7a14-4834-9b8e-14452c6cbcd7 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.183022 Aug 31 11:46:41.551331 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 262/526] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:41 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:41.631249 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6f2fb504-cd1f-4a82-b704-4d9352c68a5d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:41.643225 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6f2fb504-cd1f-4a82-b704-4d9352c68a5d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.189695 Aug 31 11:46:41.644117 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 265/527] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:41 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:41.644376 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-864e03bd-4318-43d3-aad6-5d3d4b3885ca tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:41.645154 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-864e03bd-4318-43d3-aad6-5d3d4b3885ca tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:41.652567 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-864e03bd-4318-43d3-aad6-5d3d4b3885ca tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:41.653157 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-864e03bd-4318-43d3-aad6-5d3d4b3885ca tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:41.653662 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-864e03bd-4318-43d3-aad6-5d3d4b3885ca tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:41.654696 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-864e03bd-4318-43d3-aad6-5d3d4b3885ca tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:41.655228 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-864e03bd-4318-43d3-aad6-5d3d4b3885ca tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:41.655726 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-864e03bd-4318-43d3-aad6-5d3d4b3885ca tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:41.839360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-864e03bd-4318-43d3-aad6-5d3d4b3885ca tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:41.850540 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-864e03bd-4318-43d3-aad6-5d3d4b3885ca tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1314 microversion: 2.1 time: 0.209805 Aug 31 11:46:41.851130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 263/528] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:41 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:42.394971 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-6cc45007-44e1-445a-b6dd-8707f6265872 req-74ed9e80-d4b6-4d34-ba86-a4efe12bcc96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a75232d-2df1-41c7-b73d-762fba8bd8e6", "name": "network-vif-plugged", "status": "completed", "tag": "e4add15e-9a0d-473c-9f93-9c2dbb5dee25"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:42.407877 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-6cc45007-44e1-445a-b6dd-8707f6265872 req-74ed9e80-d4b6-4d34-ba86-a4efe12bcc96 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:42.408177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-6cc45007-44e1-445a-b6dd-8707f6265872 req-74ed9e80-d4b6-4d34-ba86-a4efe12bcc96 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:42.408515 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-6cc45007-44e1-445a-b6dd-8707f6265872 req-74ed9e80-d4b6-4d34-ba86-a4efe12bcc96 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:42.430341 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-6cc45007-44e1-445a-b6dd-8707f6265872 req-74ed9e80-d4b6-4d34-ba86-a4efe12bcc96 service nova] Creating event network-vif-plugged:e4add15e-9a0d-473c-9f93-9c2dbb5dee25 for instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 on hv-cinder-83976 Aug 31 11:46:42.438431 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-6cc45007-44e1-445a-b6dd-8707f6265872 req-74ed9e80-d4b6-4d34-ba86-a4efe12bcc96 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047176 Aug 31 11:46:42.439278 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 266/529] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:46:42.571835 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a578d265-f5bc-4d20-9098-c72addbe57ef tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:42.572441 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a578d265-f5bc-4d20-9098-c72addbe57ef tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:42.579242 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a578d265-f5bc-4d20-9098-c72addbe57ef tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:42.579717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a578d265-f5bc-4d20-9098-c72addbe57ef tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:42.580100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a578d265-f5bc-4d20-9098-c72addbe57ef tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:42.580898 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a578d265-f5bc-4d20-9098-c72addbe57ef tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:42.581292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a578d265-f5bc-4d20-9098-c72addbe57ef tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:42.581756 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a578d265-f5bc-4d20-9098-c72addbe57ef tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:42.669438 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8755c46b-8e82-4e1f-9f8a-23e575499fde tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:42.670125 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8755c46b-8e82-4e1f-9f8a-23e575499fde tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:42.679606 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8755c46b-8e82-4e1f-9f8a-23e575499fde tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:42.680547 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8755c46b-8e82-4e1f-9f8a-23e575499fde tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:42.681434 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8755c46b-8e82-4e1f-9f8a-23e575499fde tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:42.682204 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8755c46b-8e82-4e1f-9f8a-23e575499fde tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:42.682658 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8755c46b-8e82-4e1f-9f8a-23e575499fde tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:42.683239 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8755c46b-8e82-4e1f-9f8a-23e575499fde tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:42.764869 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a578d265-f5bc-4d20-9098-c72addbe57ef tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:42.774955 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a578d265-f5bc-4d20-9098-c72addbe57ef tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.206727 Aug 31 11:46:42.775762 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 264/530] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:42 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:42.882802 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6b69d95c-55c7-452b-9ff2-0c391eb033cc tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:42.883237 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6b69d95c-55c7-452b-9ff2-0c391eb033cc tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:42.885137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8755c46b-8e82-4e1f-9f8a-23e575499fde tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:42.889294 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6b69d95c-55c7-452b-9ff2-0c391eb033cc tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:42.889775 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6b69d95c-55c7-452b-9ff2-0c391eb033cc tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:42.890206 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6b69d95c-55c7-452b-9ff2-0c391eb033cc tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:42.890894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6b69d95c-55c7-452b-9ff2-0c391eb033cc tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:42.891344 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6b69d95c-55c7-452b-9ff2-0c391eb033cc tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:42.891785 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6b69d95c-55c7-452b-9ff2-0c391eb033cc tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:42.892844 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8755c46b-8e82-4e1f-9f8a-23e575499fde tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.228963 Aug 31 11:46:42.893407 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 267/531] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:42 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:43.045570 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6b69d95c-55c7-452b-9ff2-0c391eb033cc tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:43.054684 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6b69d95c-55c7-452b-9ff2-0c391eb033cc tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1314 microversion: 2.1 time: 0.175820 Aug 31 11:46:43.055255 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 265/532] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:42 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:43.809350 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2ccf855c-40f6-485f-b05e-eafefec83c84 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:43.810104 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2ccf855c-40f6-485f-b05e-eafefec83c84 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:43.817192 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2ccf855c-40f6-485f-b05e-eafefec83c84 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:43.817783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2ccf855c-40f6-485f-b05e-eafefec83c84 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:43.818361 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2ccf855c-40f6-485f-b05e-eafefec83c84 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:43.819716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2ccf855c-40f6-485f-b05e-eafefec83c84 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:43.820222 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2ccf855c-40f6-485f-b05e-eafefec83c84 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:43.820701 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2ccf855c-40f6-485f-b05e-eafefec83c84 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:43.923732 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-dee71f20-d6bd-4517-b243-7bce031bf14e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:43.924945 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-dee71f20-d6bd-4517-b243-7bce031bf14e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:43.932385 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dee71f20-d6bd-4517-b243-7bce031bf14e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:43.933099 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dee71f20-d6bd-4517-b243-7bce031bf14e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:43.933618 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dee71f20-d6bd-4517-b243-7bce031bf14e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:43.934429 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dee71f20-d6bd-4517-b243-7bce031bf14e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:43.934973 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dee71f20-d6bd-4517-b243-7bce031bf14e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:43.935639 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dee71f20-d6bd-4517-b243-7bce031bf14e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:44.004230 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2ccf855c-40f6-485f-b05e-eafefec83c84 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:44.012575 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:44.020077 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2ccf855c-40f6-485f-b05e-eafefec83c84 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.215550 Aug 31 11:46:44.020682 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 268/533] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:43 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:44.080256 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2705e9b8-119e-405c-8093-356fdbb1453e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:44.080896 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2705e9b8-119e-405c-8093-356fdbb1453e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:44.087471 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2705e9b8-119e-405c-8093-356fdbb1453e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:44.088020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2705e9b8-119e-405c-8093-356fdbb1453e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:44.088415 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2705e9b8-119e-405c-8093-356fdbb1453e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:44.089180 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2705e9b8-119e-405c-8093-356fdbb1453e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:44.089631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2705e9b8-119e-405c-8093-356fdbb1453e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:44.090056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2705e9b8-119e-405c-8093-356fdbb1453e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:44.248623 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-dee71f20-d6bd-4517-b243-7bce031bf14e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:44.251066 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:44.268218 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2705e9b8-119e-405c-8093-356fdbb1453e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:44.294520 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2705e9b8-119e-405c-8093-356fdbb1453e tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1314 microversion: 2.1 time: 0.217905 Aug 31 11:46:44.304534 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 269/534] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:44 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:44.304755 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-dee71f20-d6bd-4517-b243-7bce031bf14e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.376925 Aug 31 11:46:44.304755 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 266/535] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:43 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:44.305704 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-b8f450aa-14d6-47c8-bcfb-fdc6c0e17797 req-179284c3-94f6-4ae3-9dc3-6c655cebc096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef21b30-ddbd-48de-ae8f-b814f0aa162b", "tag": "15711b93-30ee-4dfb-98f6-b23e3ef1bf5c"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:44.325758 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-b8f450aa-14d6-47c8-bcfb-fdc6c0e17797 req-179284c3-94f6-4ae3-9dc3-6c655cebc096 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:44.326524 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-b8f450aa-14d6-47c8-bcfb-fdc6c0e17797 req-179284c3-94f6-4ae3-9dc3-6c655cebc096 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:44.327276 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-b8f450aa-14d6-47c8-bcfb-fdc6c0e17797 req-179284c3-94f6-4ae3-9dc3-6c655cebc096 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:44.348459 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-b8f450aa-14d6-47c8-bcfb-fdc6c0e17797 req-179284c3-94f6-4ae3-9dc3-6c655cebc096 service nova] Creating event network-changed:15711b93-30ee-4dfb-98f6-b23e3ef1bf5c for instance fef21b30-ddbd-48de-ae8f-b814f0aa162b on hv-cinder-83976 Aug 31 11:46:44.356062 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-b8f450aa-14d6-47c8-bcfb-fdc6c0e17797 req-179284c3-94f6-4ae3-9dc3-6c655cebc096 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057705 Aug 31 11:46:44.357066 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 270/536] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:46:45.055187 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-443317bd-b63f-417c-9f81-fa8aea7bca15 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:45.055847 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-443317bd-b63f-417c-9f81-fa8aea7bca15 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:45.063891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-443317bd-b63f-417c-9f81-fa8aea7bca15 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:45.064528 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-443317bd-b63f-417c-9f81-fa8aea7bca15 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:45.065010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-443317bd-b63f-417c-9f81-fa8aea7bca15 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:45.065916 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-443317bd-b63f-417c-9f81-fa8aea7bca15 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:45.066705 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-443317bd-b63f-417c-9f81-fa8aea7bca15 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:45.067233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-443317bd-b63f-417c-9f81-fa8aea7bca15 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:45.292696 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-443317bd-b63f-417c-9f81-fa8aea7bca15 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:45.302941 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-443317bd-b63f-417c-9f81-fa8aea7bca15 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.251485 Aug 31 11:46:45.303952 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 267/537] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:45 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:45.321904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cdbfa453-3fc1-4f07-a5e5-b5e4cb07575f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:45.322937 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cdbfa453-3fc1-4f07-a5e5-b5e4cb07575f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:45.330665 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdbfa453-3fc1-4f07-a5e5-b5e4cb07575f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:45.331290 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdbfa453-3fc1-4f07-a5e5-b5e4cb07575f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:45.331716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6c0d09ef-3738-481e-8127-093513bf3025 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:45.332168 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdbfa453-3fc1-4f07-a5e5-b5e4cb07575f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:45.332721 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdbfa453-3fc1-4f07-a5e5-b5e4cb07575f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:45.332900 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6c0d09ef-3738-481e-8127-093513bf3025 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:45.333826 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdbfa453-3fc1-4f07-a5e5-b5e4cb07575f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:45.334323 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdbfa453-3fc1-4f07-a5e5-b5e4cb07575f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:45.344793 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6c0d09ef-3738-481e-8127-093513bf3025 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:45.345289 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6c0d09ef-3738-481e-8127-093513bf3025 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:45.345728 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6c0d09ef-3738-481e-8127-093513bf3025 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:45.346426 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6c0d09ef-3738-481e-8127-093513bf3025 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:45.347116 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6c0d09ef-3738-481e-8127-093513bf3025 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:45.347704 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6c0d09ef-3738-481e-8127-093513bf3025 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:45.503997 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6c0d09ef-3738-481e-8127-093513bf3025 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:45.515267 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6c0d09ef-3738-481e-8127-093513bf3025 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1314 microversion: 2.1 time: 0.198698 Aug 31 11:46:45.515846 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 271/538] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:45 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:45.610303 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cdbfa453-3fc1-4f07-a5e5-b5e4cb07575f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:45.625283 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cdbfa453-3fc1-4f07-a5e5-b5e4cb07575f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1370 microversion: 2.1 time: 0.307630 Aug 31 11:46:45.625838 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 268/539] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:45 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1370 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:46.330140 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6ca1b35d-688f-45af-b8ac-54d71ba6fdd6 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:46.331259 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6ca1b35d-688f-45af-b8ac-54d71ba6fdd6 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:46.341853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ca1b35d-688f-45af-b8ac-54d71ba6fdd6 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:46.342801 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ca1b35d-688f-45af-b8ac-54d71ba6fdd6 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:46.343302 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ca1b35d-688f-45af-b8ac-54d71ba6fdd6 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:46.344593 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ca1b35d-688f-45af-b8ac-54d71ba6fdd6 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:46.345402 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ca1b35d-688f-45af-b8ac-54d71ba6fdd6 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:46.346076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ca1b35d-688f-45af-b8ac-54d71ba6fdd6 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:46.545908 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-63510269-683c-48ae-b825-4fba3e1d52bd tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:46.548090 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-63510269-683c-48ae-b825-4fba3e1d52bd tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:46.560075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63510269-683c-48ae-b825-4fba3e1d52bd tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:46.561014 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63510269-683c-48ae-b825-4fba3e1d52bd tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:46.561733 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63510269-683c-48ae-b825-4fba3e1d52bd tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:46.562774 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63510269-683c-48ae-b825-4fba3e1d52bd tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:46.563493 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63510269-683c-48ae-b825-4fba3e1d52bd tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:46.564426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63510269-683c-48ae-b825-4fba3e1d52bd tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:46.572636 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6ca1b35d-688f-45af-b8ac-54d71ba6fdd6 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:46.588901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6ca1b35d-688f-45af-b8ac-54d71ba6fdd6 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.264726 Aug 31 11:46:46.604475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 272/540] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:46 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:46.650200 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-16489673-cdee-4fd2-9c30-a195c6558823 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:46.651122 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-16489673-cdee-4fd2-9c30-a195c6558823 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:46.658391 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-16489673-cdee-4fd2-9c30-a195c6558823 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:46.659052 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-16489673-cdee-4fd2-9c30-a195c6558823 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:46.659649 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-16489673-cdee-4fd2-9c30-a195c6558823 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:46.660603 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-16489673-cdee-4fd2-9c30-a195c6558823 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:46.661184 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-16489673-cdee-4fd2-9c30-a195c6558823 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:46.662493 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-16489673-cdee-4fd2-9c30-a195c6558823 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:46.916191 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-63510269-683c-48ae-b825-4fba3e1d52bd tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:46.937815 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-16489673-cdee-4fd2-9c30-a195c6558823 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:46.942547 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-63510269-683c-48ae-b825-4fba3e1d52bd tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1314 microversion: 2.1 time: 0.401812 Aug 31 11:46:46.961005 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 269/541] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:46 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:46.974090 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-54c58f62-b206-48e2-9932-ac91a865fc0c req-1c995278-7503-4f76-80a9-0a77205872e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30732ac7-790c-4585-9d27-a723b4a49095", "name": "network-vif-plugged", "status": "completed", "tag": "008c8ca4-7cac-42b6-9966-a441e62ec36a"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:46.976419 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-16489673-cdee-4fd2-9c30-a195c6558823 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1565 microversion: 2.1 time: 0.331283 Aug 31 11:46:46.978115 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 273/542] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:46 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1565 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:46.997807 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-54c58f62-b206-48e2-9932-ac91a865fc0c req-1c995278-7503-4f76-80a9-0a77205872e4 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:46.998590 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-54c58f62-b206-48e2-9932-ac91a865fc0c req-1c995278-7503-4f76-80a9-0a77205872e4 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:46.999237 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-54c58f62-b206-48e2-9932-ac91a865fc0c req-1c995278-7503-4f76-80a9-0a77205872e4 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:47.001795 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f7de51b3-cfeb-4a29-8179-f0b734451a8a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:47.002930 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f7de51b3-cfeb-4a29-8179-f0b734451a8a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:47.011010 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f7de51b3-cfeb-4a29-8179-f0b734451a8a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:47.011769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f7de51b3-cfeb-4a29-8179-f0b734451a8a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:47.012373 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f7de51b3-cfeb-4a29-8179-f0b734451a8a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:47.013353 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f7de51b3-cfeb-4a29-8179-f0b734451a8a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:47.014038 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f7de51b3-cfeb-4a29-8179-f0b734451a8a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:47.014677 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f7de51b3-cfeb-4a29-8179-f0b734451a8a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:47.026552 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-54c58f62-b206-48e2-9932-ac91a865fc0c req-1c995278-7503-4f76-80a9-0a77205872e4 service nova] Creating event network-vif-plugged:008c8ca4-7cac-42b6-9966-a441e62ec36a for instance 30732ac7-790c-4585-9d27-a723b4a49095 on hv-cinder-83976 Aug 31 11:46:47.033746 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-54c58f62-b206-48e2-9932-ac91a865fc0c req-1c995278-7503-4f76-80a9-0a77205872e4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070281 Aug 31 11:46:47.035529 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 270/543] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:46:47.147364 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f7de51b3-cfeb-4a29-8179-f0b734451a8a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.150243 Aug 31 11:46:47.148594 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 274/544] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 31 11:46:46 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:46:47.625482 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-94baab70-ccfb-4f6c-8609-ba47397f0ece tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:47.626991 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-94baab70-ccfb-4f6c-8609-ba47397f0ece tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:47.645600 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-94baab70-ccfb-4f6c-8609-ba47397f0ece tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:47.647845 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-94baab70-ccfb-4f6c-8609-ba47397f0ece tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:47.648359 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-94baab70-ccfb-4f6c-8609-ba47397f0ece tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:47.649645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-94baab70-ccfb-4f6c-8609-ba47397f0ece tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:47.651933 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-94baab70-ccfb-4f6c-8609-ba47397f0ece tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:47.651933 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-94baab70-ccfb-4f6c-8609-ba47397f0ece tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:47.893380 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-94baab70-ccfb-4f6c-8609-ba47397f0ece tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:47.909868 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-94baab70-ccfb-4f6c-8609-ba47397f0ece tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.295587 Aug 31 11:46:47.932522 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 271/545] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:47 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:47.975900 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-274183df-f574-4d59-b1e7-0bf380b1e5a9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:47.976669 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-274183df-f574-4d59-b1e7-0bf380b1e5a9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:47.982545 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-274183df-f574-4d59-b1e7-0bf380b1e5a9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:47.983023 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-274183df-f574-4d59-b1e7-0bf380b1e5a9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:47.983455 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-274183df-f574-4d59-b1e7-0bf380b1e5a9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:47.984168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-274183df-f574-4d59-b1e7-0bf380b1e5a9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:47.984650 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-274183df-f574-4d59-b1e7-0bf380b1e5a9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:47.985073 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-274183df-f574-4d59-b1e7-0bf380b1e5a9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:48.320924 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-274183df-f574-4d59-b1e7-0bf380b1e5a9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:48.330028 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-274183df-f574-4d59-b1e7-0bf380b1e5a9 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1314 microversion: 2.1 time: 0.359173 Aug 31 11:46:48.330697 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 275/546] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:47 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:48.690097 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-7f2edfb5-4bba-46e6-9f40-42e9c75631c1 req-88cc6752-39fc-4f42-9b20-3689f0c7ffe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a75232d-2df1-41c7-b73d-762fba8bd8e6", "tag": "e4add15e-9a0d-473c-9f93-9c2dbb5dee25"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:48.711860 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-7f2edfb5-4bba-46e6-9f40-42e9c75631c1 req-88cc6752-39fc-4f42-9b20-3689f0c7ffe3 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:48.712351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-7f2edfb5-4bba-46e6-9f40-42e9c75631c1 req-88cc6752-39fc-4f42-9b20-3689f0c7ffe3 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:48.712825 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-7f2edfb5-4bba-46e6-9f40-42e9c75631c1 req-88cc6752-39fc-4f42-9b20-3689f0c7ffe3 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:48.729608 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-7f2edfb5-4bba-46e6-9f40-42e9c75631c1 req-88cc6752-39fc-4f42-9b20-3689f0c7ffe3 service nova] Creating event network-changed:e4add15e-9a0d-473c-9f93-9c2dbb5dee25 for instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 on hv-cinder-83976 Aug 31 11:46:48.740291 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-7f2edfb5-4bba-46e6-9f40-42e9c75631c1 req-88cc6752-39fc-4f42-9b20-3689f0c7ffe3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053431 Aug 31 11:46:48.741740 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 272/547] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:46:48.946208 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b0005839-cd66-4b32-b81e-a5881722ca45 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:48.946726 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b0005839-cd66-4b32-b81e-a5881722ca45 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:48.952779 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b0005839-cd66-4b32-b81e-a5881722ca45 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:48.953267 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b0005839-cd66-4b32-b81e-a5881722ca45 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:48.953902 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b0005839-cd66-4b32-b81e-a5881722ca45 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:48.954607 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b0005839-cd66-4b32-b81e-a5881722ca45 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:48.955066 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b0005839-cd66-4b32-b81e-a5881722ca45 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:48.955493 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b0005839-cd66-4b32-b81e-a5881722ca45 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:49.159946 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b0005839-cd66-4b32-b81e-a5881722ca45 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:49.171799 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b0005839-cd66-4b32-b81e-a5881722ca45 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.233350 Aug 31 11:46:49.172586 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 276/548] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:48 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:49.361153 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-37779d52-ad15-4dfd-8d31-b6e34a16c86c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:49.362612 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-37779d52-ad15-4dfd-8d31-b6e34a16c86c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:49.366252 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=88 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:49.375754 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-37779d52-ad15-4dfd-8d31-b6e34a16c86c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:49.376734 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-37779d52-ad15-4dfd-8d31-b6e34a16c86c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:49.377516 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-37779d52-ad15-4dfd-8d31-b6e34a16c86c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:49.378518 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-37779d52-ad15-4dfd-8d31-b6e34a16c86c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:49.379332 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-37779d52-ad15-4dfd-8d31-b6e34a16c86c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:49.379958 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-37779d52-ad15-4dfd-8d31-b6e34a16c86c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:49.619300 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-37779d52-ad15-4dfd-8d31-b6e34a16c86c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:49.629898 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-37779d52-ad15-4dfd-8d31-b6e34a16c86c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1314 microversion: 2.1 time: 0.277134 Aug 31 11:46:49.641244 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 273/549] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:49 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:50.197942 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6e89e0f9-4afd-432f-a4a8-476241472480 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:50.199157 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6e89e0f9-4afd-432f-a4a8-476241472480 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:50.206705 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e89e0f9-4afd-432f-a4a8-476241472480 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:50.207215 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e89e0f9-4afd-432f-a4a8-476241472480 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:50.207874 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e89e0f9-4afd-432f-a4a8-476241472480 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:50.211059 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e89e0f9-4afd-432f-a4a8-476241472480 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:50.215085 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e89e0f9-4afd-432f-a4a8-476241472480 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:50.216092 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e89e0f9-4afd-432f-a4a8-476241472480 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:50.456362 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6e89e0f9-4afd-432f-a4a8-476241472480 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:50.468648 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6e89e0f9-4afd-432f-a4a8-476241472480 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.276932 Aug 31 11:46:50.469349 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 277/550] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:50 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:50.672683 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a0b1d323-4d05-4944-8c0c-084a309bbdc8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:50.673787 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a0b1d323-4d05-4944-8c0c-084a309bbdc8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:50.693845 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a0b1d323-4d05-4944-8c0c-084a309bbdc8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:50.694928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a0b1d323-4d05-4944-8c0c-084a309bbdc8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:50.696032 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a0b1d323-4d05-4944-8c0c-084a309bbdc8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:50.697814 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a0b1d323-4d05-4944-8c0c-084a309bbdc8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:50.698909 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a0b1d323-4d05-4944-8c0c-084a309bbdc8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:50.699942 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a0b1d323-4d05-4944-8c0c-084a309bbdc8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:50.923389 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a0b1d323-4d05-4944-8c0c-084a309bbdc8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:50.933617 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a0b1d323-4d05-4944-8c0c-084a309bbdc8 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1314 microversion: 2.1 time: 0.265377 Aug 31 11:46:50.944997 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 274/551] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:50 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:51.507288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7d4fb24c-4d3d-4205-bb03-8c822f3a47ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:51.507816 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7d4fb24c-4d3d-4205-bb03-8c822f3a47ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:51.510242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=94 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:51.515881 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7d4fb24c-4d3d-4205-bb03-8c822f3a47ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:51.516422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7d4fb24c-4d3d-4205-bb03-8c822f3a47ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:51.517002 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7d4fb24c-4d3d-4205-bb03-8c822f3a47ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:51.517809 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7d4fb24c-4d3d-4205-bb03-8c822f3a47ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:51.518281 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7d4fb24c-4d3d-4205-bb03-8c822f3a47ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:51.519847 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7d4fb24c-4d3d-4205-bb03-8c822f3a47ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:51.722568 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7d4fb24c-4d3d-4205-bb03-8c822f3a47ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:51.738501 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7d4fb24c-4d3d-4205-bb03-8c822f3a47ad tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.236570 Aug 31 11:46:51.738501 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 278/552] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:51 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:51.958548 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-51054d0e-289b-48e1-a170-83d39dfbaa5f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:51.959419 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-51054d0e-289b-48e1-a170-83d39dfbaa5f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:51.965819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-51054d0e-289b-48e1-a170-83d39dfbaa5f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:51.966305 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-51054d0e-289b-48e1-a170-83d39dfbaa5f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:51.966735 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-51054d0e-289b-48e1-a170-83d39dfbaa5f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:51.967429 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-51054d0e-289b-48e1-a170-83d39dfbaa5f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:51.967880 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-51054d0e-289b-48e1-a170-83d39dfbaa5f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:51.968304 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-51054d0e-289b-48e1-a170-83d39dfbaa5f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:52.102331 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-51054d0e-289b-48e1-a170-83d39dfbaa5f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:52.110150 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-51054d0e-289b-48e1-a170-83d39dfbaa5f tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1314 microversion: 2.1 time: 0.155433 Aug 31 11:46:52.110708 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 275/553] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:51 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:52.767186 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fe434b44-fe0a-4398-b70f-54067a3f9133 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:52.767813 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fe434b44-fe0a-4398-b70f-54067a3f9133 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:52.774869 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fe434b44-fe0a-4398-b70f-54067a3f9133 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:52.775346 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fe434b44-fe0a-4398-b70f-54067a3f9133 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:52.775777 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fe434b44-fe0a-4398-b70f-54067a3f9133 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:52.776459 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fe434b44-fe0a-4398-b70f-54067a3f9133 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:52.776935 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fe434b44-fe0a-4398-b70f-54067a3f9133 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:52.777358 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fe434b44-fe0a-4398-b70f-54067a3f9133 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:52.920351 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-fe434b44-fe0a-4398-b70f-54067a3f9133 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:52.928500 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-fe434b44-fe0a-4398-b70f-54067a3f9133 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.165112 Aug 31 11:46:52.929077 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 279/554] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:52 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:53.135470 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-59c823d2-f8e2-4f1f-b118-937d47051b1d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:53.136372 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-59c823d2-f8e2-4f1f-b118-937d47051b1d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:53.142020 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-59c823d2-f8e2-4f1f-b118-937d47051b1d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:53.142497 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-59c823d2-f8e2-4f1f-b118-937d47051b1d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:53.142920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-59c823d2-f8e2-4f1f-b118-937d47051b1d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:53.143594 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-59c823d2-f8e2-4f1f-b118-937d47051b1d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:53.144035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-59c823d2-f8e2-4f1f-b118-937d47051b1d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:53.144447 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-59c823d2-f8e2-4f1f-b118-937d47051b1d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:53.305716 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-59c823d2-f8e2-4f1f-b118-937d47051b1d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:53.315009 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-59c823d2-f8e2-4f1f-b118-937d47051b1d tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1314 microversion: 2.1 time: 0.183494 Aug 31 11:46:53.321074 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 276/555] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:53 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:53.464658 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-6a249239-32ee-440f-956d-b81f472b78df req-8d4ca441-f93d-43b9-a4ff-6d5fbee51d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef21b30-ddbd-48de-ae8f-b814f0aa162b", "name": "network-vif-plugged", "status": "completed", "tag": "15711b93-30ee-4dfb-98f6-b23e3ef1bf5c"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:53.475841 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-6a249239-32ee-440f-956d-b81f472b78df req-8d4ca441-f93d-43b9-a4ff-6d5fbee51d7e service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:53.477003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-6a249239-32ee-440f-956d-b81f472b78df req-8d4ca441-f93d-43b9-a4ff-6d5fbee51d7e service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:53.477509 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-6a249239-32ee-440f-956d-b81f472b78df req-8d4ca441-f93d-43b9-a4ff-6d5fbee51d7e service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:53.490704 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-6a249239-32ee-440f-956d-b81f472b78df req-8d4ca441-f93d-43b9-a4ff-6d5fbee51d7e service nova] Creating event network-vif-plugged:15711b93-30ee-4dfb-98f6-b23e3ef1bf5c for instance fef21b30-ddbd-48de-ae8f-b814f0aa162b on hv-cinder-83976 Aug 31 11:46:53.496287 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-6a249239-32ee-440f-956d-b81f472b78df req-8d4ca441-f93d-43b9-a4ff-6d5fbee51d7e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035188 Aug 31 11:46:53.496927 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 280/556] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:46:53.950152 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c5d85b6c-225b-49df-9419-20e3306c0108 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:53.951111 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c5d85b6c-225b-49df-9419-20e3306c0108 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:53.958929 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5d85b6c-225b-49df-9419-20e3306c0108 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:53.959938 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5d85b6c-225b-49df-9419-20e3306c0108 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:53.960391 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5d85b6c-225b-49df-9419-20e3306c0108 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:53.961154 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5d85b6c-225b-49df-9419-20e3306c0108 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:53.961613 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5d85b6c-225b-49df-9419-20e3306c0108 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:53.962043 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5d85b6c-225b-49df-9419-20e3306c0108 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:54.105420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c5d85b6c-225b-49df-9419-20e3306c0108 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:54.114272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c5d85b6c-225b-49df-9419-20e3306c0108 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1358 microversion: 2.1 time: 0.168489 Aug 31 11:46:54.116535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 277/557] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:53 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:54.325332 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b10a79b4-ba90-47ac-ac59-f7d1ec9254fb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:54.325916 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b10a79b4-ba90-47ac-ac59-f7d1ec9254fb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:54.332633 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b10a79b4-ba90-47ac-ac59-f7d1ec9254fb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:54.333125 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b10a79b4-ba90-47ac-ac59-f7d1ec9254fb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:54.334657 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b10a79b4-ba90-47ac-ac59-f7d1ec9254fb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:54.335362 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b10a79b4-ba90-47ac-ac59-f7d1ec9254fb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:54.335816 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b10a79b4-ba90-47ac-ac59-f7d1ec9254fb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:54.336245 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b10a79b4-ba90-47ac-ac59-f7d1ec9254fb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:54.337236 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-bf75cbcf-aeef-46a4-9b5c-1ad546212aeb tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:54.337845 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-bf75cbcf-aeef-46a4-9b5c-1ad546212aeb tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:54.343829 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bf75cbcf-aeef-46a4-9b5c-1ad546212aeb tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:54.344315 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bf75cbcf-aeef-46a4-9b5c-1ad546212aeb tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:54.344784 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bf75cbcf-aeef-46a4-9b5c-1ad546212aeb tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:54.345832 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bf75cbcf-aeef-46a4-9b5c-1ad546212aeb tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:54.346302 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bf75cbcf-aeef-46a4-9b5c-1ad546212aeb tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:54.346807 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bf75cbcf-aeef-46a4-9b5c-1ad546212aeb tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:54.361718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b10a79b4-ba90-47ac-ac59-f7d1ec9254fb tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446/ips" status: 200 len: 148 microversion: 2.1 time: 0.043635 Aug 31 11:46:54.362302 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 281/558] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 31 11:46:54 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446/ips => generated 148 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:46:54.529622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-bf75cbcf-aeef-46a4-9b5c-1ad546212aeb tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:54.542695 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-bf75cbcf-aeef-46a4-9b5c-1ad546212aeb tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1314 microversion: 2.1 time: 0.209789 Aug 31 11:46:54.543433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 278/559] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:54 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:54.862589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7b7efd18-91dc-4c01-95c0-251e3a1b6a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:54.864194 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7b7efd18-91dc-4c01-95c0-251e3a1b6a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:54.872331 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b7efd18-91dc-4c01-95c0-251e3a1b6a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:54.872871 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b7efd18-91dc-4c01-95c0-251e3a1b6a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:54.873282 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b7efd18-91dc-4c01-95c0-251e3a1b6a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:54.873988 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b7efd18-91dc-4c01-95c0-251e3a1b6a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:54.874438 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b7efd18-91dc-4c01-95c0-251e3a1b6a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:54.874858 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b7efd18-91dc-4c01-95c0-251e3a1b6a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:54.899810 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7b7efd18-91dc-4c01-95c0-251e3a1b6a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/ips" status: 200 len: 152 microversion: 2.20 time: 0.047080 Aug 31 11:46:54.900090 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 282/560] 10.222.0.60 () {60 vars in 1289 bytes} [Wed Aug 31 11:46:54 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/ips => generated 152 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:46:54.980814 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-48ff506d-ccf9-47c9-809e-882e84e73656 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:54.981332 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-48ff506d-ccf9-47c9-809e-882e84e73656 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:54.987123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-48ff506d-ccf9-47c9-809e-882e84e73656 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:54.987602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-48ff506d-ccf9-47c9-809e-882e84e73656 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:54.988066 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-48ff506d-ccf9-47c9-809e-882e84e73656 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:54.988775 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-48ff506d-ccf9-47c9-809e-882e84e73656 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:54.989224 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-48ff506d-ccf9-47c9-809e-882e84e73656 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:54.990179 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-48ff506d-ccf9-47c9-809e-882e84e73656 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:55.014965 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-48ff506d-ccf9-47c9-809e-882e84e73656 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/ips" status: 200 len: 145 microversion: 2.1 time: 0.038427 Aug 31 11:46:55.015543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 279/561] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 31 11:46:54 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:46:55.136322 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-cb06187c-226d-4772-be9c-9c26bb942f4f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:55.137163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-cb06187c-226d-4772-be9c-9c26bb942f4f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:55.143785 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cb06187c-226d-4772-be9c-9c26bb942f4f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:55.144407 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cb06187c-226d-4772-be9c-9c26bb942f4f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:55.144982 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cb06187c-226d-4772-be9c-9c26bb942f4f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:55.146321 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cb06187c-226d-4772-be9c-9c26bb942f4f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:55.146925 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cb06187c-226d-4772-be9c-9c26bb942f4f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:55.147436 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cb06187c-226d-4772-be9c-9c26bb942f4f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:55.409754 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-cb06187c-226d-4772-be9c-9c26bb942f4f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:55.422936 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-cb06187c-226d-4772-be9c-9c26bb942f4f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1548 microversion: 2.1 time: 0.290591 Aug 31 11:46:55.423729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 283/562] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:55 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1548 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:55.451475 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-359e9c84-340a-43e2-b070-ccbe573c61cd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:55.452558 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-359e9c84-340a-43e2-b070-ccbe573c61cd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:55.463008 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-359e9c84-340a-43e2-b070-ccbe573c61cd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:55.463928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-359e9c84-340a-43e2-b070-ccbe573c61cd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:55.464801 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-359e9c84-340a-43e2-b070-ccbe573c61cd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:55.465863 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-359e9c84-340a-43e2-b070-ccbe573c61cd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:55.466534 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-359e9c84-340a-43e2-b070-ccbe573c61cd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:55.467217 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-359e9c84-340a-43e2-b070-ccbe573c61cd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:55.565151 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a73ec0c8-232b-46d9-beef-e9fc72b9b320 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:55.566504 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a73ec0c8-232b-46d9-beef-e9fc72b9b320 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:55.578173 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a73ec0c8-232b-46d9-beef-e9fc72b9b320 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:55.578859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a73ec0c8-232b-46d9-beef-e9fc72b9b320 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:55.580009 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a73ec0c8-232b-46d9-beef-e9fc72b9b320 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:55.584012 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a73ec0c8-232b-46d9-beef-e9fc72b9b320 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:55.585849 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a73ec0c8-232b-46d9-beef-e9fc72b9b320 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:55.587532 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a73ec0c8-232b-46d9-beef-e9fc72b9b320 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:55.661058 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-359e9c84-340a-43e2-b070-ccbe573c61cd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:55.674573 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-359e9c84-340a-43e2-b070-ccbe573c61cd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1548 microversion: 2.1 time: 0.229060 Aug 31 11:46:55.689355 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 280/563] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:55 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1548 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:55.711847 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d6a91db1-975b-454c-a109-692cd3125a8e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:55.720007 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d6a91db1-975b-454c-a109-692cd3125a8e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:55.721491 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d6a91db1-975b-454c-a109-692cd3125a8e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Searching by: {'deleted': False, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430'} {{(pid=127062) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 11:46:55.735192 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6a91db1-975b-454c-a109-692cd3125a8e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:55.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6a91db1-975b-454c-a109-692cd3125a8e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:55.737135 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6a91db1-975b-454c-a109-692cd3125a8e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:55.738331 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6a91db1-975b-454c-a109-692cd3125a8e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:55.738813 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6a91db1-975b-454c-a109-692cd3125a8e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:55.739934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6a91db1-975b-454c-a109-692cd3125a8e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:55.855038 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a73ec0c8-232b-46d9-beef-e9fc72b9b320 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:55.890940 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a73ec0c8-232b-46d9-beef-e9fc72b9b320 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1314 microversion: 2.1 time: 0.330716 Aug 31 11:46:55.891972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 284/564] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:55 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:55.924375 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b378a912-2486-454d-b91e-499629d12ec2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ba03f5f-7e61-49f0-a1e0-80cafa355d18"}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:55.930343 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b378a912-2486-454d-b91e-499629d12ec2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:55.942402 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b378a912-2486-454d-b91e-499629d12ec2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:55.943714 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b378a912-2486-454d-b91e-499629d12ec2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:55.944600 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b378a912-2486-454d-b91e-499629d12ec2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:55.945874 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b378a912-2486-454d-b91e-499629d12ec2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:55.946544 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b378a912-2486-454d-b91e-499629d12ec2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:55.947052 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b378a912-2486-454d-b91e-499629d12ec2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:55.950780 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.multi_cell_list [None req-d6a91db1-975b-454c-a109-692cd3125a8e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127062) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 11:46:56.150488 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d6a91db1-975b-454c-a109-692cd3125a8e tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.444637 Aug 31 11:46:56.153445 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 281/565] 10.222.0.60 () {58 vars in 1125 bytes} [Wed Aug 31 11:46:55 2022] GET /compute/v2.1/servers => generated 342 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:46:56.180834 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-90e723cb-cabf-41a4-9be3-dece459aab8f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:56.182737 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-90e723cb-cabf-41a4-9be3-dece459aab8f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:56.197875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-90e723cb-cabf-41a4-9be3-dece459aab8f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:56.198520 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-90e723cb-cabf-41a4-9be3-dece459aab8f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:56.198976 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-90e723cb-cabf-41a4-9be3-dece459aab8f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:56.200185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-90e723cb-cabf-41a4-9be3-dece459aab8f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:56.201004 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-90e723cb-cabf-41a4-9be3-dece459aab8f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:56.202115 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-90e723cb-cabf-41a4-9be3-dece459aab8f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:56.527719 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-90e723cb-cabf-41a4-9be3-dece459aab8f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:56.539720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-90e723cb-cabf-41a4-9be3-dece459aab8f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1548 microversion: 2.1 time: 0.365299 Aug 31 11:46:56.540553 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 282/566] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:56 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1548 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:56.585040 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b378a912-2486-454d-b91e-499629d12ec2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "POST /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.668571 Aug 31 11:46:56.586268 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 285/567] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 31 11:46:55 2022] POST /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446/os-volume_attachments => generated 194 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:46:56.953565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cf74160d-1f0b-4e3f-b6e7-b4a0b3101a41 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:56.956291 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cf74160d-1f0b-4e3f-b6e7-b4a0b3101a41 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:56.969913 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf74160d-1f0b-4e3f-b6e7-b4a0b3101a41 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:56.970865 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf74160d-1f0b-4e3f-b6e7-b4a0b3101a41 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:56.971886 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf74160d-1f0b-4e3f-b6e7-b4a0b3101a41 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:56.973185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf74160d-1f0b-4e3f-b6e7-b4a0b3101a41 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:56.974828 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf74160d-1f0b-4e3f-b6e7-b4a0b3101a41 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:56.975720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf74160d-1f0b-4e3f-b6e7-b4a0b3101a41 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:57.171456 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cf74160d-1f0b-4e3f-b6e7-b4a0b3101a41 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:57.187019 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cf74160d-1f0b-4e3f-b6e7-b4a0b3101a41 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1463 microversion: 2.1 time: 0.240933 Aug 31 11:46:57.188115 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 283/568] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:56 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1463 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:57.276304 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bb599eb1-56a6-44c8-b4ef-a81a65fe10ae tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:57.277142 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-bb599eb1-56a6-44c8-b4ef-a81a65fe10ae tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:57.289828 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bb599eb1-56a6-44c8-b4ef-a81a65fe10ae tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:57.290645 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bb599eb1-56a6-44c8-b4ef-a81a65fe10ae tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:57.291317 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bb599eb1-56a6-44c8-b4ef-a81a65fe10ae tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:57.292301 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bb599eb1-56a6-44c8-b4ef-a81a65fe10ae tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:57.293147 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bb599eb1-56a6-44c8-b4ef-a81a65fe10ae tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:57.293832 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bb599eb1-56a6-44c8-b4ef-a81a65fe10ae tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:57.325141 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:57.352102 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-bb599eb1-56a6-44c8-b4ef-a81a65fe10ae tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Going to try to terminate instance {{(pid=127061) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:46:57.529153 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-bb599eb1-56a6-44c8-b4ef-a81a65fe10ae tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 204 len: 0 microversion: 2.1 time: 0.260246 Aug 31 11:46:57.530829 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 286/569] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:46:57 2022] DELETE /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:46:57.547467 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-440f35a1-329b-49fc-a4b2-4a1c68e5bf6c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:57.549238 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-440f35a1-329b-49fc-a4b2-4a1c68e5bf6c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:57.563182 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-440f35a1-329b-49fc-a4b2-4a1c68e5bf6c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:57.564123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-440f35a1-329b-49fc-a4b2-4a1c68e5bf6c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:57.564865 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-440f35a1-329b-49fc-a4b2-4a1c68e5bf6c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:57.566786 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-440f35a1-329b-49fc-a4b2-4a1c68e5bf6c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:57.568936 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-440f35a1-329b-49fc-a4b2-4a1c68e5bf6c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:57.569594 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-440f35a1-329b-49fc-a4b2-4a1c68e5bf6c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:57.665995 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b366890c-94af-461d-8f9b-fd4c2e2f953c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae6f6c8c-f7b1-4e70-9f82-b7b9a210d842"}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:57.669617 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b366890c-94af-461d-8f9b-fd4c2e2f953c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:57.689999 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b366890c-94af-461d-8f9b-fd4c2e2f953c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:57.690976 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b366890c-94af-461d-8f9b-fd4c2e2f953c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:57.691871 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b366890c-94af-461d-8f9b-fd4c2e2f953c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:57.693855 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b366890c-94af-461d-8f9b-fd4c2e2f953c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:57.694382 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b366890c-94af-461d-8f9b-fd4c2e2f953c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:57.695116 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b366890c-94af-461d-8f9b-fd4c2e2f953c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:57.778729 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-440f35a1-329b-49fc-a4b2-4a1c68e5bf6c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:57.784084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:46:57.790784 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-440f35a1-329b-49fc-a4b2-4a1c68e5bf6c tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1469 microversion: 2.1 time: 0.251207 Aug 31 11:46:57.791958 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 284/570] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:57 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1469 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:46:58.216765 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c771e24e-a8c2-4529-9f74-a4442e9a1835 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:58.217653 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c771e24e-a8c2-4529-9f74-a4442e9a1835 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:58.232827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c771e24e-a8c2-4529-9f74-a4442e9a1835 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:58.233428 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c771e24e-a8c2-4529-9f74-a4442e9a1835 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:58.236375 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c771e24e-a8c2-4529-9f74-a4442e9a1835 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:58.238343 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c771e24e-a8c2-4529-9f74-a4442e9a1835 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:58.240074 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c771e24e-a8c2-4529-9f74-a4442e9a1835 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:58.246434 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c771e24e-a8c2-4529-9f74-a4442e9a1835 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:58.322553 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.objects.instance [None req-c771e24e-a8c2-4529-9f74-a4442e9a1835 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lazy-loading 'flavor' on Instance uuid 06215e54-27bb-4685-9a34-14109d73c81e {{(pid=127062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:46:58.676615 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c771e24e-a8c2-4529-9f74-a4442e9a1835 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "POST /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/action" status: 202 len: 0 microversion: 2.20 time: 0.467594 Aug 31 11:46:58.678736 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 285/571] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Aug 31 11:46:58 2022] POST /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:46:58.696145 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e3c7266e-1ac7-4108-9395-1b31ac531aeb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:58.697359 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e3c7266e-1ac7-4108-9395-1b31ac531aeb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:58.705757 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e3c7266e-1ac7-4108-9395-1b31ac531aeb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:58.706332 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e3c7266e-1ac7-4108-9395-1b31ac531aeb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:58.706857 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e3c7266e-1ac7-4108-9395-1b31ac531aeb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:58.707696 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e3c7266e-1ac7-4108-9395-1b31ac531aeb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:58.708558 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e3c7266e-1ac7-4108-9395-1b31ac531aeb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:58.709622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e3c7266e-1ac7-4108-9395-1b31ac531aeb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:58.863164 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e3c7266e-1ac7-4108-9395-1b31ac531aeb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:58.872044 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e3c7266e-1ac7-4108-9395-1b31ac531aeb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:58.873493 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e3c7266e-1ac7-4108-9395-1b31ac531aeb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:58.874640 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e3c7266e-1ac7-4108-9395-1b31ac531aeb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.188016 Aug 31 11:46:58.875195 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 286/572] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:46:58 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:46:58.879649 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b6e4e589-e474-4a6a-8bfd-908a179aa561 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc8b93ca-e245-4ef1-98f3-71935316a361", "device": "/dev/sdb"}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:58.883011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b6e4e589-e474-4a6a-8bfd-908a179aa561 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:58.888871 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b6e4e589-e474-4a6a-8bfd-908a179aa561 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:58.889491 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b6e4e589-e474-4a6a-8bfd-908a179aa561 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:58.889912 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b6e4e589-e474-4a6a-8bfd-908a179aa561 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:58.890944 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b6e4e589-e474-4a6a-8bfd-908a179aa561 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:58.891390 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b6e4e589-e474-4a6a-8bfd-908a179aa561 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:58.891805 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b6e4e589-e474-4a6a-8bfd-908a179aa561 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:59.484842 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b366890c-94af-461d-8f9b-fd4c2e2f953c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "POST /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.823226 Aug 31 11:46:59.488651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 287/573] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 31 11:46:57 2022] POST /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/os-volume_attachments => generated 194 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:46:59.500737 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-31c1f055-8e9a-45bb-9245-80935688c5ff tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:59.513938 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-31c1f055-8e9a-45bb-9245-80935688c5ff tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:59.535367 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31c1f055-8e9a-45bb-9245-80935688c5ff tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:59.537479 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31c1f055-8e9a-45bb-9245-80935688c5ff tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:59.538359 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31c1f055-8e9a-45bb-9245-80935688c5ff tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:59.539578 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31c1f055-8e9a-45bb-9245-80935688c5ff tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:59.540773 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31c1f055-8e9a-45bb-9245-80935688c5ff tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:59.541931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31c1f055-8e9a-45bb-9245-80935688c5ff tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:59.829744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-31c1f055-8e9a-45bb-9245-80935688c5ff tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:46:59.838884 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b6e4e589-e474-4a6a-8bfd-908a179aa561 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "POST /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.962039 Aug 31 11:46:59.850388 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 287/574] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 31 11:46:58 2022] POST /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714/os-volume_attachments => generated 194 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:46:59.850727 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-31c1f055-8e9a-45bb-9245-80935688c5ff tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1469 microversion: 2.1 time: 0.350739 Aug 31 11:46:59.850727 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 288/575] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:46:59 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1469 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:46:59.851101 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-65ab92b4-b36e-4a97-8691-6f80c3281f2a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0105f8a-e6fa-4b0a-87ee-425820f43264"}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:46:59.856106 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-65ab92b4-b36e-4a97-8691-6f80c3281f2a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:59.885896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65ab92b4-b36e-4a97-8691-6f80c3281f2a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:59.886587 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65ab92b4-b36e-4a97-8691-6f80c3281f2a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:59.887301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65ab92b4-b36e-4a97-8691-6f80c3281f2a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:59.888542 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65ab92b4-b36e-4a97-8691-6f80c3281f2a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:59.903272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65ab92b4-b36e-4a97-8691-6f80c3281f2a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:59.904002 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f17a1627-5113-430f-a864-3817595670e1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:46:59.904928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65ab92b4-b36e-4a97-8691-6f80c3281f2a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:59.905144 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f17a1627-5113-430f-a864-3817595670e1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:46:59.920162 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f17a1627-5113-430f-a864-3817595670e1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:59.921585 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f17a1627-5113-430f-a864-3817595670e1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:59.922598 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f17a1627-5113-430f-a864-3817595670e1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:46:59.923557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f17a1627-5113-430f-a864-3817595670e1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:46:59.924303 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f17a1627-5113-430f-a864-3817595670e1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:46:59.930006 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f17a1627-5113-430f-a864-3817595670e1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:00.156384 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f17a1627-5113-430f-a864-3817595670e1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:00.181213 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f17a1627-5113-430f-a864-3817595670e1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:00.183933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f17a1627-5113-430f-a864-3817595670e1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:00.185781 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f17a1627-5113-430f-a864-3817595670e1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.290156 Aug 31 11:47:00.187144 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 289/576] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:46:59 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:00.335635 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-65ab92b4-b36e-4a97-8691-6f80c3281f2a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "POST /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.493272 Aug 31 11:47:00.336246 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 288/577] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 31 11:46:59 2022] POST /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/os-volume_attachments => generated 194 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:47:00.381799 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-0be04ead-4a0f-4eeb-b1ec-bfb14f7e7abb req-0c39796d-7ae0-4777-801a-08a7fbf30670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef21b30-ddbd-48de-ae8f-b814f0aa162b", "name": "network-vif-deleted", "tag": "15711b93-30ee-4dfb-98f6-b23e3ef1bf5c"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:47:00.401765 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-0be04ead-4a0f-4eeb-b1ec-bfb14f7e7abb req-0c39796d-7ae0-4777-801a-08a7fbf30670 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:00.402603 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-0be04ead-4a0f-4eeb-b1ec-bfb14f7e7abb req-0c39796d-7ae0-4777-801a-08a7fbf30670 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:00.403366 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-0be04ead-4a0f-4eeb-b1ec-bfb14f7e7abb req-0c39796d-7ae0-4777-801a-08a7fbf30670 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:00.429345 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-0be04ead-4a0f-4eeb-b1ec-bfb14f7e7abb req-0c39796d-7ae0-4777-801a-08a7fbf30670 service nova] Creating event network-vif-deleted:15711b93-30ee-4dfb-98f6-b23e3ef1bf5c for instance fef21b30-ddbd-48de-ae8f-b814f0aa162b on hv-cinder-83976 Aug 31 11:47:00.439610 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-0be04ead-4a0f-4eeb-b1ec-bfb14f7e7abb req-0c39796d-7ae0-4777-801a-08a7fbf30670 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062444 Aug 31 11:47:00.446241 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 290/578] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:47:00.883059 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3f507a03-1515-490b-a81f-4f85665fada4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:00.883803 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3f507a03-1515-490b-a81f-4f85665fada4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:00.890452 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3f507a03-1515-490b-a81f-4f85665fada4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:00.890974 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3f507a03-1515-490b-a81f-4f85665fada4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:00.891456 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3f507a03-1515-490b-a81f-4f85665fada4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:00.892193 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3f507a03-1515-490b-a81f-4f85665fada4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:00.892727 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3f507a03-1515-490b-a81f-4f85665fada4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:00.893183 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3f507a03-1515-490b-a81f-4f85665fada4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:00.927350 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3f507a03-1515-490b-a81f-4f85665fada4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:00.928183 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3f507a03-1515-490b-a81f-4f85665fada4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:00.928650 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3f507a03-1515-490b-a81f-4f85665fada4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:00.929097 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.objects.instance [None req-3f507a03-1515-490b-a81f-4f85665fada4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lazy-loading 'fault' on Instance uuid fef21b30-ddbd-48de-ae8f-b814f0aa162b {{(pid=127062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:47:00.979351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3f507a03-1515-490b-a81f-4f85665fada4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14dfcf40ed34d0b912599cbafeef8ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2351e519c01641e7aa832e41ad030cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:00.987214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3f507a03-1515-490b-a81f-4f85665fada4 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 200 len: 1304 microversion: 2.1 time: 0.110121 Aug 31 11:47:00.987781 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 289/579] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:00 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:47:01.210998 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-60365929-4cf3-47e1-bbe6-ac7eb30b44fe tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:01.211810 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-60365929-4cf3-47e1-bbe6-ac7eb30b44fe tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:01.218650 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-60365929-4cf3-47e1-bbe6-ac7eb30b44fe tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:01.219238 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-60365929-4cf3-47e1-bbe6-ac7eb30b44fe tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:01.219958 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-60365929-4cf3-47e1-bbe6-ac7eb30b44fe tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:01.220720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-60365929-4cf3-47e1-bbe6-ac7eb30b44fe tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:01.221325 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-60365929-4cf3-47e1-bbe6-ac7eb30b44fe tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:01.221941 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-60365929-4cf3-47e1-bbe6-ac7eb30b44fe tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:01.365998 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-60365929-4cf3-47e1-bbe6-ac7eb30b44fe tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:01.379305 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-60365929-4cf3-47e1-bbe6-ac7eb30b44fe tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:01.381313 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-60365929-4cf3-47e1-bbe6-ac7eb30b44fe tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:01.382487 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-60365929-4cf3-47e1-bbe6-ac7eb30b44fe tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.176233 Aug 31 11:47:01.383050 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 291/580] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:01 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:02.010048 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-37876185-750e-42f1-ac83-1d3cdfeae644 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:02.010645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-37876185-750e-42f1-ac83-1d3cdfeae644 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] [instance: fef21b30-ddbd-48de-ae8f-b814f0aa162b] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:02.017984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-37876185-750e-42f1-ac83-1d3cdfeae644 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:02.018535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-37876185-750e-42f1-ac83-1d3cdfeae644 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:02.018990 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-37876185-750e-42f1-ac83-1d3cdfeae644 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:02.019760 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-37876185-750e-42f1-ac83-1d3cdfeae644 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:02.020234 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-37876185-750e-42f1-ac83-1d3cdfeae644 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:02.020791 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-37876185-750e-42f1-ac83-1d3cdfeae644 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:02.034894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-37876185-750e-42f1-ac83-1d3cdfeae644 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] HTTP exception thrown: Instance fef21b30-ddbd-48de-ae8f-b814f0aa162b could not be found. Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-37876185-750e-42f1-ac83-1d3cdfeae644 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Request method failure captured: Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b HTTP/1.1 Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0oG0wbcnrXyhd1ar-56SX_6chajBc6VeEgo1soNCewp31GaX_qZtTP5Ta0nuF5cuiktSxUd5W2xFcEBCXgseFb2nZdXhOc5zrzAQPLTepuJ3xes06kFD8mqiDr0DZpNdXrXLHKBm7lZRYnguUGszJzmF4sdtNR-49sTWnbREDw5eVw Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 2351e519c01641e7aa832e41ad030cf8 Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-VolumesNegativeTest-1868339337 Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:47:02.037657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:47:02.039214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2351e519c01641e7aa832e41ad030cf8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2351e519c01641e7aa832e41ad030cf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2351e519c01641e7aa832e41ad030cf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2351e519c01641e7aa832e41ad030cf8"}]}] Aug 31 11:47:02.039214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-VolumesNegativeTest-1868339337 Aug 31 11:47:02.039214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 2351e519c01641e7aa832e41ad030cf8 Aug 31 11:47:02.039214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-VolumesNegativeTest-1868339337 Aug 31 11:47:02.039214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-VolumesNegativeTest-1868339337-project Aug 31 11:47:02.039214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:47:02.039214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:47:02.039214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: c14dfcf40ed34d0b912599cbafeef8ca Aug 31 11:47:02.039214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-VolumesNegativeTest-1868339337-project Aug 31 11:47:02.039214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:47:02.039214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance fef21b30-ddbd-48de-ae8f-b814f0aa162b could not be found. Aug 31 11:47:02.039214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': 'fef21b30-ddbd-48de-ae8f-b814f0aa162b'} Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef21b30-ddbd-48de-ae8f-b814f0aa162b could not be found. Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:47:02.040222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef21b30-ddbd-48de-ae8f-b814f0aa162b could not be found. Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef21b30-ddbd-48de-ae8f-b814f0aa162b could not be found. Aug 31 11:47:02.041672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:47:02.042949 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-37876185-750e-42f1-ac83-1d3cdfeae644 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] Returning 404 to user: Instance fef21b30-ddbd-48de-ae8f-b814f0aa162b could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:47:02.042949 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-37876185-750e-42f1-ac83-1d3cdfeae644 tempest-VolumesNegativeTest-1868339337 tempest-VolumesNegativeTest-1868339337-project] 10.222.0.60 "GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b" status: 404 len: 111 microversion: 2.1 time: 0.033477 Aug 31 11:47:02.042949 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 290/581] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:02 2022] GET /compute/v2.1/servers/fef21b30-ddbd-48de-ae8f-b814f0aa162b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:47:02.405040 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-cd31687f-f0c7-4fe5-ad88-f18d26c16aa2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:02.405811 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-cd31687f-f0c7-4fe5-ad88-f18d26c16aa2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:02.413907 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cd31687f-f0c7-4fe5-ad88-f18d26c16aa2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:02.414465 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cd31687f-f0c7-4fe5-ad88-f18d26c16aa2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:02.415456 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cd31687f-f0c7-4fe5-ad88-f18d26c16aa2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:02.416232 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cd31687f-f0c7-4fe5-ad88-f18d26c16aa2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:02.416723 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cd31687f-f0c7-4fe5-ad88-f18d26c16aa2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:02.417152 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cd31687f-f0c7-4fe5-ad88-f18d26c16aa2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:02.588528 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-cd31687f-f0c7-4fe5-ad88-f18d26c16aa2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:02.594657 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-cd31687f-f0c7-4fe5-ad88-f18d26c16aa2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:02.596233 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-cd31687f-f0c7-4fe5-ad88-f18d26c16aa2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:02.597582 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-cd31687f-f0c7-4fe5-ad88-f18d26c16aa2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.196417 Aug 31 11:47:02.598246 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 292/582] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:02 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:47:03.622642 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f6a37e59-b1d8-40dc-8b9f-195a35d5b7c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:03.623591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f6a37e59-b1d8-40dc-8b9f-195a35d5b7c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:03.630501 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6a37e59-b1d8-40dc-8b9f-195a35d5b7c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:03.631013 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6a37e59-b1d8-40dc-8b9f-195a35d5b7c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:03.631443 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6a37e59-b1d8-40dc-8b9f-195a35d5b7c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:03.632130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6a37e59-b1d8-40dc-8b9f-195a35d5b7c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:03.632891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6a37e59-b1d8-40dc-8b9f-195a35d5b7c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:03.633030 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6a37e59-b1d8-40dc-8b9f-195a35d5b7c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:03.799938 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f6a37e59-b1d8-40dc-8b9f-195a35d5b7c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:03.808289 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f6a37e59-b1d8-40dc-8b9f-195a35d5b7c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:03.809752 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f6a37e59-b1d8-40dc-8b9f-195a35d5b7c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:03.810890 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f6a37e59-b1d8-40dc-8b9f-195a35d5b7c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.193093 Aug 31 11:47:03.811440 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 291/583] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:03 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:47:04.833622 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-13235592-6cc0-44ce-a9e7-803194df0056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:04.834786 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-13235592-6cc0-44ce-a9e7-803194df0056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:04.842138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13235592-6cc0-44ce-a9e7-803194df0056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:04.842635 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13235592-6cc0-44ce-a9e7-803194df0056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:04.843286 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13235592-6cc0-44ce-a9e7-803194df0056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:04.843286 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13235592-6cc0-44ce-a9e7-803194df0056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:04.843286 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13235592-6cc0-44ce-a9e7-803194df0056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:04.844822 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13235592-6cc0-44ce-a9e7-803194df0056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:05.001717 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-13235592-6cc0-44ce-a9e7-803194df0056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:05.010366 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-13235592-6cc0-44ce-a9e7-803194df0056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:05.011788 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-13235592-6cc0-44ce-a9e7-803194df0056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:05.012992 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-13235592-6cc0-44ce-a9e7-803194df0056 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.183447 Aug 31 11:47:05.013542 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 293/584] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:04 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:47:06.038221 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6e5373b8-4be5-4f25-bae4-a6151d29e02c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:06.038828 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6e5373b8-4be5-4f25-bae4-a6151d29e02c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:06.042598 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:06.046971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e5373b8-4be5-4f25-bae4-a6151d29e02c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:06.047589 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e5373b8-4be5-4f25-bae4-a6151d29e02c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:06.048144 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e5373b8-4be5-4f25-bae4-a6151d29e02c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:06.048869 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e5373b8-4be5-4f25-bae4-a6151d29e02c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:06.049319 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e5373b8-4be5-4f25-bae4-a6151d29e02c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:06.049737 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e5373b8-4be5-4f25-bae4-a6151d29e02c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:06.189110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6e5373b8-4be5-4f25-bae4-a6151d29e02c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:06.198862 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6e5373b8-4be5-4f25-bae4-a6151d29e02c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:06.200286 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6e5373b8-4be5-4f25-bae4-a6151d29e02c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:06.201473 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6e5373b8-4be5-4f25-bae4-a6151d29e02c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.168524 Aug 31 11:47:06.202027 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 292/585] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:06 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:06.535807 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f000807f-dab4-45a8-81e8-547dd8b4e09a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Action: 'create', calling method: .version_select at 0x7f1738278ca0>, body: {"keypair": {"name": "tempest-keypair-118047113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzJf5MxUbe3wuYpdrgIfnhdzWY8ZQ1O0eq6vyWm1u2J/SlO3rivR7ZHLUE1UGP54v1w2bdOTjoUOeYD+PTrPmSpFO/UHSbNXHSz8r7c96EcPH9Gak2+NjQUyLl3G7Zqiw=="}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:47:06.553020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-f000807f-dab4-45a8-81e8-547dd8b4e09a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for project b4ac4dc41f7e420d811483990e020f22. Resources: {'key_pairs'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:47:06.557758 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-f000807f-dab4-45a8-81e8-547dd8b4e09a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for user 5de832888ffd4a69ae88cac6b632304e and project b4ac4dc41f7e420d811483990e020f22. Resources: {'key_pairs'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:47:06.580845 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f000807f-dab4-45a8-81e8-547dd8b4e09a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048804 Aug 31 11:47:06.584710 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 294/586] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 31 11:47:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:47:07.228443 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-458794f1-0d8f-4304-9bd2-4eeabb5e2c8d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:07.232220 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-458794f1-0d8f-4304-9bd2-4eeabb5e2c8d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:07.245063 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-458794f1-0d8f-4304-9bd2-4eeabb5e2c8d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:07.245781 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-458794f1-0d8f-4304-9bd2-4eeabb5e2c8d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:07.246221 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-458794f1-0d8f-4304-9bd2-4eeabb5e2c8d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:07.248254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-458794f1-0d8f-4304-9bd2-4eeabb5e2c8d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:07.248254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-458794f1-0d8f-4304-9bd2-4eeabb5e2c8d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:07.248254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-458794f1-0d8f-4304-9bd2-4eeabb5e2c8d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:07.519278 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-458794f1-0d8f-4304-9bd2-4eeabb5e2c8d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:07.530653 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-458794f1-0d8f-4304-9bd2-4eeabb5e2c8d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:07.532448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-458794f1-0d8f-4304-9bd2-4eeabb5e2c8d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:07.533640 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-458794f1-0d8f-4304-9bd2-4eeabb5e2c8d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.310692 Aug 31 11:47:07.534193 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 293/587] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:07 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:08.346128 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1092402945", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5aa6b83-6517-47ce-979a-ff78821ec50d"}], "security_groups": [{"name": "tempest-securitygroup--2022205941"}], "key_name": "tempest-keypair-118047113", "user_data": "}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:47:08.470041 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.network.neutron [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] validate_networks() for [('e5aa6b83-6517-47ce-979a-ff78821ec50d', None, None, None, None, None)] {{(pid=127061) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:47:08.558268 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f2871b21-a9fd-4750-8bda-e7ac5747b713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:08.558894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f2871b21-a9fd-4750-8bda-e7ac5747b713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:08.565494 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f2871b21-a9fd-4750-8bda-e7ac5747b713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:08.565977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f2871b21-a9fd-4750-8bda-e7ac5747b713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:08.566680 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f2871b21-a9fd-4750-8bda-e7ac5747b713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:08.567954 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f2871b21-a9fd-4750-8bda-e7ac5747b713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:08.568577 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f2871b21-a9fd-4750-8bda-e7ac5747b713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:08.569012 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f2871b21-a9fd-4750-8bda-e7ac5747b713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:08.715612 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f2871b21-a9fd-4750-8bda-e7ac5747b713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:08.725015 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f2871b21-a9fd-4750-8bda-e7ac5747b713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:08.726299 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f2871b21-a9fd-4750-8bda-e7ac5747b713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:08.727461 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f2871b21-a9fd-4750-8bda-e7ac5747b713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.173194 Aug 31 11:47:08.728053 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 294/588] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:08 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:47:08.885420 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Flavor limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:47:08.885832 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Image limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:47:08.886291 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Flavor pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:47:08.886687 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Image pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:47:08.887083 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:47:08.895951 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:08.896415 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:08.896871 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:08.897697 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:08.898141 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:08.898555 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:08.915044 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for project b4ac4dc41f7e420d811483990e020f22. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:47:08.918873 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for user 5de832888ffd4a69ae88cac6b632304e and project b4ac4dc41f7e420d811483990e020f22. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:47:08.930064 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Going to run 1 instances... {{(pid=127061) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:47:08.932288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127061) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:47:08.986308 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b4786454-2cd1-4499-bfc5-1821b0bb0b54 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.644429 Aug 31 11:47:08.987381 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 295/589] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:47:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:47:09.000290 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f5e8afcd-c62c-4300-8ab7-1bda9419904f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:09.000930 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f5e8afcd-c62c-4300-8ab7-1bda9419904f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:09.058112 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f5e8afcd-c62c-4300-8ab7-1bda9419904f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:09.065139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f5e8afcd-c62c-4300-8ab7-1bda9419904f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1241 microversion: 2.1 time: 0.069167 Aug 31 11:47:09.065776 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 295/590] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:08 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:47:09.757430 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e68c9e97-6260-4afb-b02c-1790a67f3936 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:09.758572 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e68c9e97-6260-4afb-b02c-1790a67f3936 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:09.769744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e68c9e97-6260-4afb-b02c-1790a67f3936 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:09.770638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e68c9e97-6260-4afb-b02c-1790a67f3936 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:09.771419 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e68c9e97-6260-4afb-b02c-1790a67f3936 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:09.773672 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e68c9e97-6260-4afb-b02c-1790a67f3936 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:09.774279 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e68c9e97-6260-4afb-b02c-1790a67f3936 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:09.774773 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e68c9e97-6260-4afb-b02c-1790a67f3936 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:09.983820 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e68c9e97-6260-4afb-b02c-1790a67f3936 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:09.996327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e68c9e97-6260-4afb-b02c-1790a67f3936 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:09.999161 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e68c9e97-6260-4afb-b02c-1790a67f3936 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:10.000758 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e68c9e97-6260-4afb-b02c-1790a67f3936 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.252360 Aug 31 11:47:10.001945 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 296/591] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:09 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:10.091089 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2a189671-d972-427a-a7d3-7d25892cc288 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:10.092143 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2a189671-d972-427a-a7d3-7d25892cc288 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:10.103932 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2a189671-d972-427a-a7d3-7d25892cc288 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:10.104914 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2a189671-d972-427a-a7d3-7d25892cc288 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:10.105743 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2a189671-d972-427a-a7d3-7d25892cc288 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:10.107068 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2a189671-d972-427a-a7d3-7d25892cc288 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:10.107938 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2a189671-d972-427a-a7d3-7d25892cc288 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:10.108774 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2a189671-d972-427a-a7d3-7d25892cc288 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:10.208965 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2a189671-d972-427a-a7d3-7d25892cc288 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:10.219549 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2a189671-d972-427a-a7d3-7d25892cc288 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1293 microversion: 2.1 time: 0.136508 Aug 31 11:47:10.221927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 296/592] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:10 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1293 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:47:11.044104 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-39666f65-a873-4a1f-a830-b7099096cbd7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:11.045053 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-39666f65-a873-4a1f-a830-b7099096cbd7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:11.054453 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39666f65-a873-4a1f-a830-b7099096cbd7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:11.055086 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39666f65-a873-4a1f-a830-b7099096cbd7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:11.055646 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39666f65-a873-4a1f-a830-b7099096cbd7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:11.056604 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39666f65-a873-4a1f-a830-b7099096cbd7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:11.057196 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39666f65-a873-4a1f-a830-b7099096cbd7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:11.057748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39666f65-a873-4a1f-a830-b7099096cbd7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:11.257996 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1d2c1389-d0bf-413a-8a83-67f821db1ae7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:11.259188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1d2c1389-d0bf-413a-8a83-67f821db1ae7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:11.271768 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1d2c1389-d0bf-413a-8a83-67f821db1ae7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:11.273714 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1d2c1389-d0bf-413a-8a83-67f821db1ae7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:11.275416 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1d2c1389-d0bf-413a-8a83-67f821db1ae7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:11.276296 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1d2c1389-d0bf-413a-8a83-67f821db1ae7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:11.277328 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1d2c1389-d0bf-413a-8a83-67f821db1ae7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:11.278195 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1d2c1389-d0bf-413a-8a83-67f821db1ae7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:11.284128 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-39666f65-a873-4a1f-a830-b7099096cbd7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:11.298175 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-39666f65-a873-4a1f-a830-b7099096cbd7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:11.301432 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-39666f65-a873-4a1f-a830-b7099096cbd7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:11.303517 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-39666f65-a873-4a1f-a830-b7099096cbd7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.264684 Aug 31 11:47:11.304693 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 297/593] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:11 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:47:11.384553 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1d2c1389-d0bf-413a-8a83-67f821db1ae7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:11.393886 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1d2c1389-d0bf-413a-8a83-67f821db1ae7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1299 microversion: 2.1 time: 0.142796 Aug 31 11:47:11.394472 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 297/594] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:11 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1299 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:12.337470 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f1575b04-1868-4514-9dc3-2954b0f2a6ab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:12.338565 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f1575b04-1868-4514-9dc3-2954b0f2a6ab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:12.349687 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f1575b04-1868-4514-9dc3-2954b0f2a6ab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:12.350508 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f1575b04-1868-4514-9dc3-2954b0f2a6ab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:12.351418 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f1575b04-1868-4514-9dc3-2954b0f2a6ab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:12.353218 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f1575b04-1868-4514-9dc3-2954b0f2a6ab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:12.358645 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f1575b04-1868-4514-9dc3-2954b0f2a6ab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:12.359461 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f1575b04-1868-4514-9dc3-2954b0f2a6ab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:12.430435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-057380eb-dcaa-42c9-ad73-9a8b38fd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:12.431200 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-057380eb-dcaa-42c9-ad73-9a8b38fd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:12.451335 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-057380eb-dcaa-42c9-ad73-9a8b38fd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:12.457233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-057380eb-dcaa-42c9-ad73-9a8b38fd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:12.458595 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-057380eb-dcaa-42c9-ad73-9a8b38fd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:12.460469 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-057380eb-dcaa-42c9-ad73-9a8b38fd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:12.463122 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-057380eb-dcaa-42c9-ad73-9a8b38fd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:12.464208 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-057380eb-dcaa-42c9-ad73-9a8b38fd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:12.543954 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:12.693591 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f1575b04-1868-4514-9dc3-2954b0f2a6ab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:12.704455 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f1575b04-1868-4514-9dc3-2954b0f2a6ab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:12.706113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f1575b04-1868-4514-9dc3-2954b0f2a6ab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:12.707395 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f1575b04-1868-4514-9dc3-2954b0f2a6ab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.378388 Aug 31 11:47:12.708678 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 298/595] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:12 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:47:12.739979 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a1576be7-aedb-4eb8-89d1-7d826237e1a1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:47:12.746162 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1576be7-aedb-4eb8-89d1-7d826237e1a1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:12.746653 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1576be7-aedb-4eb8-89d1-7d826237e1a1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:12.747086 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1576be7-aedb-4eb8-89d1-7d826237e1a1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:12.837612 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a1576be7-aedb-4eb8-89d1-7d826237e1a1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Going to try to stop instance {{(pid=127061) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 11:47:12.901746 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a1576be7-aedb-4eb8-89d1-7d826237e1a1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "POST /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/action" status: 202 len: 0 microversion: 2.1 time: 0.165526 Aug 31 11:47:12.903231 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 299/596] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 31 11:47:12 2022] POST /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:47:12.918058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-58bb4353-e0b9-4a07-9f50-388c29d71141 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:12.919060 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-58bb4353-e0b9-4a07-9f50-388c29d71141 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:12.930304 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-58bb4353-e0b9-4a07-9f50-388c29d71141 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:12.931483 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-58bb4353-e0b9-4a07-9f50-388c29d71141 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:12.932395 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-58bb4353-e0b9-4a07-9f50-388c29d71141 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:12.933879 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-58bb4353-e0b9-4a07-9f50-388c29d71141 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:12.934737 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-58bb4353-e0b9-4a07-9f50-388c29d71141 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:12.935561 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-58bb4353-e0b9-4a07-9f50-388c29d71141 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:12.996512 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-057380eb-dcaa-42c9-ad73-9a8b38fd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:13.011540 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-057380eb-dcaa-42c9-ad73-9a8b38fd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.595220 Aug 31 11:47:13.029414 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 298/597] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:12 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:13.165662 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-58bb4353-e0b9-4a07-9f50-388c29d71141 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:13.181711 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-58bb4353-e0b9-4a07-9f50-388c29d71141 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.272572 Aug 31 11:47:13.182892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 300/598] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:12 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:47:13.484763 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-b6cc2fc1-c0d5-45d7-bf79-50464d036eb3 req-8e3689f6-dd1b-4d61-85a2-ab5610c33121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89973a85-9500-443c-b017-ceeb73cfc3be", "tag": "297bf55c-ede0-4ca0-8f41-ab94a1b08c26"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:47:13.495852 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-b6cc2fc1-c0d5-45d7-bf79-50464d036eb3 req-8e3689f6-dd1b-4d61-85a2-ab5610c33121 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:13.496324 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-b6cc2fc1-c0d5-45d7-bf79-50464d036eb3 req-8e3689f6-dd1b-4d61-85a2-ab5610c33121 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:13.496773 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-b6cc2fc1-c0d5-45d7-bf79-50464d036eb3 req-8e3689f6-dd1b-4d61-85a2-ab5610c33121 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:13.513726 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-b6cc2fc1-c0d5-45d7-bf79-50464d036eb3 req-8e3689f6-dd1b-4d61-85a2-ab5610c33121 service nova] Creating event network-changed:297bf55c-ede0-4ca0-8f41-ab94a1b08c26 for instance 89973a85-9500-443c-b017-ceeb73cfc3be on hv-cinder-83976 Aug 31 11:47:13.522385 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-b6cc2fc1-c0d5-45d7-bf79-50464d036eb3 req-8e3689f6-dd1b-4d61-85a2-ab5610c33121 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039094 Aug 31 11:47:13.522385 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 299/599] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:47:13.746712 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8559c9a6-61f0-404f-a8d0-eb0b47319d9b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:13.747373 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8559c9a6-61f0-404f-a8d0-eb0b47319d9b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:13.755305 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8559c9a6-61f0-404f-a8d0-eb0b47319d9b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:13.756240 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8559c9a6-61f0-404f-a8d0-eb0b47319d9b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:13.756768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8559c9a6-61f0-404f-a8d0-eb0b47319d9b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:13.757427 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8559c9a6-61f0-404f-a8d0-eb0b47319d9b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:13.757902 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8559c9a6-61f0-404f-a8d0-eb0b47319d9b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:13.758315 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8559c9a6-61f0-404f-a8d0-eb0b47319d9b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:13.775688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:13.925828 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8559c9a6-61f0-404f-a8d0-eb0b47319d9b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:13.936418 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8559c9a6-61f0-404f-a8d0-eb0b47319d9b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:13.937928 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8559c9a6-61f0-404f-a8d0-eb0b47319d9b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:13.939103 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8559c9a6-61f0-404f-a8d0-eb0b47319d9b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.196628 Aug 31 11:47:13.939655 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 301/600] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:13 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:14.050375 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b0e5560b-d2c9-4e3f-8eac-e89cca21d3fd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:14.051277 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b0e5560b-d2c9-4e3f-8eac-e89cca21d3fd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:14.058388 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b0e5560b-d2c9-4e3f-8eac-e89cca21d3fd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:14.058870 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b0e5560b-d2c9-4e3f-8eac-e89cca21d3fd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:14.059300 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b0e5560b-d2c9-4e3f-8eac-e89cca21d3fd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:14.060369 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b0e5560b-d2c9-4e3f-8eac-e89cca21d3fd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:14.061052 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b0e5560b-d2c9-4e3f-8eac-e89cca21d3fd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:14.061485 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b0e5560b-d2c9-4e3f-8eac-e89cca21d3fd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:14.208442 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b0e5560b-d2c9-4e3f-8eac-e89cca21d3fd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:14.218811 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b0e5560b-d2c9-4e3f-8eac-e89cca21d3fd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.172569 Aug 31 11:47:14.219392 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 300/601] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:14 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:14.224067 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-94db5aad-1a98-4cf6-a0e1-d9394afff491 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:14.224716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-94db5aad-1a98-4cf6-a0e1-d9394afff491 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:14.231738 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94db5aad-1a98-4cf6-a0e1-d9394afff491 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:14.232216 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94db5aad-1a98-4cf6-a0e1-d9394afff491 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:14.232701 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94db5aad-1a98-4cf6-a0e1-d9394afff491 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:14.233509 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94db5aad-1a98-4cf6-a0e1-d9394afff491 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:14.233996 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94db5aad-1a98-4cf6-a0e1-d9394afff491 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:14.234437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94db5aad-1a98-4cf6-a0e1-d9394afff491 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:14.428660 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-94db5aad-1a98-4cf6-a0e1-d9394afff491 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:14.442992 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-94db5aad-1a98-4cf6-a0e1-d9394afff491 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.221759 Aug 31 11:47:14.443994 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 302/602] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:14 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:14.977257 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-65c9d404-0419-42ed-8e04-a29b9dbe2d51 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:14.977849 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-65c9d404-0419-42ed-8e04-a29b9dbe2d51 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:14.984873 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65c9d404-0419-42ed-8e04-a29b9dbe2d51 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:14.985417 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65c9d404-0419-42ed-8e04-a29b9dbe2d51 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:14.985887 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65c9d404-0419-42ed-8e04-a29b9dbe2d51 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:14.986677 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65c9d404-0419-42ed-8e04-a29b9dbe2d51 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:14.987186 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65c9d404-0419-42ed-8e04-a29b9dbe2d51 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:14.987678 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-65c9d404-0419-42ed-8e04-a29b9dbe2d51 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:15.136857 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-65c9d404-0419-42ed-8e04-a29b9dbe2d51 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:15.149353 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-65c9d404-0419-42ed-8e04-a29b9dbe2d51 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:15.150779 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-65c9d404-0419-42ed-8e04-a29b9dbe2d51 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:15.151973 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-65c9d404-0419-42ed-8e04-a29b9dbe2d51 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.179605 Aug 31 11:47:15.152546 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 301/603] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:14 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:15.254301 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-003ea97e-b1ea-4d0a-b8ac-9b97ac78711c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:15.255922 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-003ea97e-b1ea-4d0a-b8ac-9b97ac78711c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:15.264139 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-003ea97e-b1ea-4d0a-b8ac-9b97ac78711c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:15.264668 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-003ea97e-b1ea-4d0a-b8ac-9b97ac78711c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:15.265220 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-003ea97e-b1ea-4d0a-b8ac-9b97ac78711c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:15.265898 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-003ea97e-b1ea-4d0a-b8ac-9b97ac78711c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:15.266334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-003ea97e-b1ea-4d0a-b8ac-9b97ac78711c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:15.266745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-003ea97e-b1ea-4d0a-b8ac-9b97ac78711c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:15.417935 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-003ea97e-b1ea-4d0a-b8ac-9b97ac78711c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:15.425576 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-003ea97e-b1ea-4d0a-b8ac-9b97ac78711c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.177999 Aug 31 11:47:15.426146 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 303/604] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:15 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:15.474289 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9bff3c5d-06e5-4344-ad46-dea25fde6120 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:15.474886 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9bff3c5d-06e5-4344-ad46-dea25fde6120 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:15.480831 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9bff3c5d-06e5-4344-ad46-dea25fde6120 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:15.481310 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9bff3c5d-06e5-4344-ad46-dea25fde6120 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:15.481741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9bff3c5d-06e5-4344-ad46-dea25fde6120 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:15.482432 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9bff3c5d-06e5-4344-ad46-dea25fde6120 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:15.482872 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9bff3c5d-06e5-4344-ad46-dea25fde6120 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:15.483291 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9bff3c5d-06e5-4344-ad46-dea25fde6120 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:15.652731 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9bff3c5d-06e5-4344-ad46-dea25fde6120 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:15.662600 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9bff3c5d-06e5-4344-ad46-dea25fde6120 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.191940 Aug 31 11:47:15.663287 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 302/605] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:15 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:16.175624 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fca3f199-0c8a-4aae-b002-544f2a6e1b8a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:16.176235 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fca3f199-0c8a-4aae-b002-544f2a6e1b8a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:16.184632 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fca3f199-0c8a-4aae-b002-544f2a6e1b8a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:16.185130 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fca3f199-0c8a-4aae-b002-544f2a6e1b8a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:16.185559 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fca3f199-0c8a-4aae-b002-544f2a6e1b8a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:16.186264 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fca3f199-0c8a-4aae-b002-544f2a6e1b8a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:16.186720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fca3f199-0c8a-4aae-b002-544f2a6e1b8a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:16.187149 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fca3f199-0c8a-4aae-b002-544f2a6e1b8a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:16.327752 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-fca3f199-0c8a-4aae-b002-544f2a6e1b8a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:16.336645 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-fca3f199-0c8a-4aae-b002-544f2a6e1b8a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:16.338095 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-fca3f199-0c8a-4aae-b002-544f2a6e1b8a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:16.339274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-fca3f199-0c8a-4aae-b002-544f2a6e1b8a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.167927 Aug 31 11:47:16.339815 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 304/606] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:16 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:16.446969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ce0ef463-f0ec-4195-a13e-59f9cd9ec50f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:16.447545 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ce0ef463-f0ec-4195-a13e-59f9cd9ec50f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:16.453999 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ce0ef463-f0ec-4195-a13e-59f9cd9ec50f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:16.454480 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ce0ef463-f0ec-4195-a13e-59f9cd9ec50f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:16.454911 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ce0ef463-f0ec-4195-a13e-59f9cd9ec50f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:16.455596 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ce0ef463-f0ec-4195-a13e-59f9cd9ec50f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:16.456046 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ce0ef463-f0ec-4195-a13e-59f9cd9ec50f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:16.456466 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ce0ef463-f0ec-4195-a13e-59f9cd9ec50f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:16.601287 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ce0ef463-f0ec-4195-a13e-59f9cd9ec50f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:16.609210 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ce0ef463-f0ec-4195-a13e-59f9cd9ec50f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.166147 Aug 31 11:47:16.609775 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 303/607] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:16 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:16.687463 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-79ae4a74-9191-4276-b9af-cc1b99b709d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:16.688061 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-79ae4a74-9191-4276-b9af-cc1b99b709d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:16.694998 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-79ae4a74-9191-4276-b9af-cc1b99b709d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:16.695470 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-79ae4a74-9191-4276-b9af-cc1b99b709d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:16.695895 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-79ae4a74-9191-4276-b9af-cc1b99b709d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:16.696614 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-79ae4a74-9191-4276-b9af-cc1b99b709d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:16.697115 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-79ae4a74-9191-4276-b9af-cc1b99b709d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:16.697471 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-79ae4a74-9191-4276-b9af-cc1b99b709d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:16.832919 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-79ae4a74-9191-4276-b9af-cc1b99b709d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:16.844397 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-79ae4a74-9191-4276-b9af-cc1b99b709d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.161035 Aug 31 11:47:16.845002 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 305/608] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:16 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:17.362626 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-82c3585d-fecc-4b12-9395-1927d611cb87 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:17.363224 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-82c3585d-fecc-4b12-9395-1927d611cb87 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:17.369260 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-82c3585d-fecc-4b12-9395-1927d611cb87 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:17.369735 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-82c3585d-fecc-4b12-9395-1927d611cb87 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:17.370159 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-82c3585d-fecc-4b12-9395-1927d611cb87 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:17.370839 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-82c3585d-fecc-4b12-9395-1927d611cb87 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:17.371276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-82c3585d-fecc-4b12-9395-1927d611cb87 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:17.371773 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-82c3585d-fecc-4b12-9395-1927d611cb87 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:17.511633 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-82c3585d-fecc-4b12-9395-1927d611cb87 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:17.521463 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-82c3585d-fecc-4b12-9395-1927d611cb87 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:17.523115 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-82c3585d-fecc-4b12-9395-1927d611cb87 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:17.524348 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-82c3585d-fecc-4b12-9395-1927d611cb87 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.165607 Aug 31 11:47:17.524955 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 304/609] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:17 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:47:17.630362 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-eb629215-36f1-40a1-a307-5602c950670d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:17.630972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-eb629215-36f1-40a1-a307-5602c950670d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:17.638808 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eb629215-36f1-40a1-a307-5602c950670d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:17.639445 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eb629215-36f1-40a1-a307-5602c950670d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:17.639911 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eb629215-36f1-40a1-a307-5602c950670d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:17.640785 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eb629215-36f1-40a1-a307-5602c950670d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:17.641121 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eb629215-36f1-40a1-a307-5602c950670d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:17.641540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eb629215-36f1-40a1-a307-5602c950670d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:17.782767 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-eb629215-36f1-40a1-a307-5602c950670d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:17.791360 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-eb629215-36f1-40a1-a307-5602c950670d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.165235 Aug 31 11:47:17.792034 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 306/610] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:17 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:17.867095 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8a11c4a3-27b5-4d64-88c2-3297ac79f5b6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:17.867736 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8a11c4a3-27b5-4d64-88c2-3297ac79f5b6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:17.874061 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8a11c4a3-27b5-4d64-88c2-3297ac79f5b6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:17.874554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8a11c4a3-27b5-4d64-88c2-3297ac79f5b6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:17.874997 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8a11c4a3-27b5-4d64-88c2-3297ac79f5b6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:17.875708 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8a11c4a3-27b5-4d64-88c2-3297ac79f5b6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:17.876155 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8a11c4a3-27b5-4d64-88c2-3297ac79f5b6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:17.876609 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8a11c4a3-27b5-4d64-88c2-3297ac79f5b6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:18.017890 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8a11c4a3-27b5-4d64-88c2-3297ac79f5b6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:18.029688 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8a11c4a3-27b5-4d64-88c2-3297ac79f5b6 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.167292 Aug 31 11:47:18.030711 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 305/611] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:17 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:18.547514 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-da9447c8-0689-41a8-8913-8687e21f308a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:18.548026 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-da9447c8-0689-41a8-8913-8687e21f308a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:18.554200 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-da9447c8-0689-41a8-8913-8687e21f308a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:18.554961 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-da9447c8-0689-41a8-8913-8687e21f308a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:18.555394 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-da9447c8-0689-41a8-8913-8687e21f308a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:18.556084 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-da9447c8-0689-41a8-8913-8687e21f308a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:18.556546 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-da9447c8-0689-41a8-8913-8687e21f308a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:18.556969 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-da9447c8-0689-41a8-8913-8687e21f308a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:18.689332 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-da9447c8-0689-41a8-8913-8687e21f308a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:18.697968 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-da9447c8-0689-41a8-8913-8687e21f308a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:18.699404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-da9447c8-0689-41a8-8913-8687e21f308a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:18.700586 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-da9447c8-0689-41a8-8913-8687e21f308a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.157148 Aug 31 11:47:18.701146 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 307/612] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:18 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:18.812422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-25942f79-ddba-410c-8fcf-a97d4e4c9082 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:18.813186 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-25942f79-ddba-410c-8fcf-a97d4e4c9082 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:18.819877 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-25942f79-ddba-410c-8fcf-a97d4e4c9082 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:18.820461 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-25942f79-ddba-410c-8fcf-a97d4e4c9082 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:18.820989 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-25942f79-ddba-410c-8fcf-a97d4e4c9082 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:18.821686 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-25942f79-ddba-410c-8fcf-a97d4e4c9082 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:18.822310 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-25942f79-ddba-410c-8fcf-a97d4e4c9082 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:18.822735 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-25942f79-ddba-410c-8fcf-a97d4e4c9082 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:18.997831 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-25942f79-ddba-410c-8fcf-a97d4e4c9082 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:19.006479 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-25942f79-ddba-410c-8fcf-a97d4e4c9082 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.197973 Aug 31 11:47:19.007461 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 306/613] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:18 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:19.052304 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-71c9b4e8-e26c-4b74-bfbd-3608c5de9403 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:19.053160 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-71c9b4e8-e26c-4b74-bfbd-3608c5de9403 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:19.055412 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:19.056305 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=10 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:19.062638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71c9b4e8-e26c-4b74-bfbd-3608c5de9403 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:19.063025 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71c9b4e8-e26c-4b74-bfbd-3608c5de9403 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:19.063468 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71c9b4e8-e26c-4b74-bfbd-3608c5de9403 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:19.064211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71c9b4e8-e26c-4b74-bfbd-3608c5de9403 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:19.064693 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71c9b4e8-e26c-4b74-bfbd-3608c5de9403 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:19.065125 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71c9b4e8-e26c-4b74-bfbd-3608c5de9403 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:19.206272 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-71c9b4e8-e26c-4b74-bfbd-3608c5de9403 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:19.215236 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-71c9b4e8-e26c-4b74-bfbd-3608c5de9403 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.167622 Aug 31 11:47:19.215804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 308/614] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:19 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:19.724820 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-76e57c75-489a-4718-ae57-c24d9bfa61ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:19.725671 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-76e57c75-489a-4718-ae57-c24d9bfa61ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:19.731121 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:19.731987 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=72 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:19.733991 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76e57c75-489a-4718-ae57-c24d9bfa61ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:19.734546 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76e57c75-489a-4718-ae57-c24d9bfa61ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:19.735420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76e57c75-489a-4718-ae57-c24d9bfa61ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:19.735890 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76e57c75-489a-4718-ae57-c24d9bfa61ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:19.736595 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76e57c75-489a-4718-ae57-c24d9bfa61ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:19.737118 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76e57c75-489a-4718-ae57-c24d9bfa61ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:19.771731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-75e5a5de-c446-429a-af00-6ab3ea199c0d req-d4d78961-e1c4-4724-bdc0-2326d350df00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06215e54-27bb-4685-9a34-14109d73c81e", "name": "network-vif-plugged", "status": "completed", "tag": "c4e2bf04-c687-4686-9210-e0be89d06923"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:47:19.791074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-75e5a5de-c446-429a-af00-6ab3ea199c0d req-d4d78961-e1c4-4724-bdc0-2326d350df00 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:19.791631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-75e5a5de-c446-429a-af00-6ab3ea199c0d req-d4d78961-e1c4-4724-bdc0-2326d350df00 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:19.792320 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-75e5a5de-c446-429a-af00-6ab3ea199c0d req-d4d78961-e1c4-4724-bdc0-2326d350df00 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:19.808525 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-75e5a5de-c446-429a-af00-6ab3ea199c0d req-d4d78961-e1c4-4724-bdc0-2326d350df00 service nova] Creating event network-vif-plugged:c4e2bf04-c687-4686-9210-e0be89d06923 for instance 06215e54-27bb-4685-9a34-14109d73c81e on hv-cinder-83976 Aug 31 11:47:19.814373 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-75e5a5de-c446-429a-af00-6ab3ea199c0d req-d4d78961-e1c4-4724-bdc0-2326d350df00 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046821 Aug 31 11:47:19.815119 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 309/615] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:47:19.912698 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-76e57c75-489a-4718-ae57-c24d9bfa61ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:19.921589 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-76e57c75-489a-4718-ae57-c24d9bfa61ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:19.923078 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-76e57c75-489a-4718-ae57-c24d9bfa61ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:19.924267 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-76e57c75-489a-4718-ae57-c24d9bfa61ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.204610 Aug 31 11:47:19.924880 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 307/616] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:19 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:20.030966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7b67b8f5-abb6-4931-abc8-81f87dcf7eb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:20.031149 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7b67b8f5-abb6-4931-abc8-81f87dcf7eb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:20.037492 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b67b8f5-abb6-4931-abc8-81f87dcf7eb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:20.038013 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b67b8f5-abb6-4931-abc8-81f87dcf7eb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:20.039804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b67b8f5-abb6-4931-abc8-81f87dcf7eb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:20.039804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b67b8f5-abb6-4931-abc8-81f87dcf7eb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:20.039804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b67b8f5-abb6-4931-abc8-81f87dcf7eb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:20.040102 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b67b8f5-abb6-4931-abc8-81f87dcf7eb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:20.172249 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7b67b8f5-abb6-4931-abc8-81f87dcf7eb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:20.180712 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7b67b8f5-abb6-4931-abc8-81f87dcf7eb6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.154927 Aug 31 11:47:20.181284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 310/617] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:20 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:20.236847 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-73cbfc46-4c69-4273-9165-69b0eb8d53e7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:20.237457 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-73cbfc46-4c69-4273-9165-69b0eb8d53e7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:20.245882 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-73cbfc46-4c69-4273-9165-69b0eb8d53e7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:20.246362 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-73cbfc46-4c69-4273-9165-69b0eb8d53e7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:20.246785 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-73cbfc46-4c69-4273-9165-69b0eb8d53e7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:20.247481 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-73cbfc46-4c69-4273-9165-69b0eb8d53e7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:20.247929 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-73cbfc46-4c69-4273-9165-69b0eb8d53e7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:20.248349 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-73cbfc46-4c69-4273-9165-69b0eb8d53e7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:20.383497 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-73cbfc46-4c69-4273-9165-69b0eb8d53e7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:20.391648 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-73cbfc46-4c69-4273-9165-69b0eb8d53e7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.159590 Aug 31 11:47:20.392203 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 308/618] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:20 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:20.947905 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-898e2f2c-7fa3-4bad-b35c-fff9c4219a05 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:20.948443 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-898e2f2c-7fa3-4bad-b35c-fff9c4219a05 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:20.954831 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-898e2f2c-7fa3-4bad-b35c-fff9c4219a05 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:20.955313 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-898e2f2c-7fa3-4bad-b35c-fff9c4219a05 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:20.955746 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-898e2f2c-7fa3-4bad-b35c-fff9c4219a05 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:20.956433 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-898e2f2c-7fa3-4bad-b35c-fff9c4219a05 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:20.956917 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-898e2f2c-7fa3-4bad-b35c-fff9c4219a05 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:20.957344 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-898e2f2c-7fa3-4bad-b35c-fff9c4219a05 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:21.089168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-898e2f2c-7fa3-4bad-b35c-fff9c4219a05 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:21.097172 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-898e2f2c-7fa3-4bad-b35c-fff9c4219a05 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:21.099338 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-898e2f2c-7fa3-4bad-b35c-fff9c4219a05 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:21.100504 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-898e2f2c-7fa3-4bad-b35c-fff9c4219a05 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.156541 Aug 31 11:47:21.101129 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 311/619] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:20 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:21.201821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3d3549bf-4896-493c-9549-0cd5c345d0d8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:21.202362 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3d3549bf-4896-493c-9549-0cd5c345d0d8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:21.208752 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3d3549bf-4896-493c-9549-0cd5c345d0d8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:21.209234 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3d3549bf-4896-493c-9549-0cd5c345d0d8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:21.209662 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3d3549bf-4896-493c-9549-0cd5c345d0d8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:21.210345 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3d3549bf-4896-493c-9549-0cd5c345d0d8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:21.210793 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3d3549bf-4896-493c-9549-0cd5c345d0d8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:21.211216 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3d3549bf-4896-493c-9549-0cd5c345d0d8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:21.340411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3d3549bf-4896-493c-9549-0cd5c345d0d8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:21.347958 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3d3549bf-4896-493c-9549-0cd5c345d0d8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.150042 Aug 31 11:47:21.349093 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 309/620] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:21 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:21.412820 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-38519353-c0c8-487c-9ae1-ca55b9de8665 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:21.413492 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-38519353-c0c8-487c-9ae1-ca55b9de8665 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:21.415441 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:21.421418 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38519353-c0c8-487c-9ae1-ca55b9de8665 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:21.421891 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38519353-c0c8-487c-9ae1-ca55b9de8665 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:21.422317 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38519353-c0c8-487c-9ae1-ca55b9de8665 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:21.422990 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38519353-c0c8-487c-9ae1-ca55b9de8665 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:21.423442 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38519353-c0c8-487c-9ae1-ca55b9de8665 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:21.423853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38519353-c0c8-487c-9ae1-ca55b9de8665 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:21.554675 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-38519353-c0c8-487c-9ae1-ca55b9de8665 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:21.562766 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-38519353-c0c8-487c-9ae1-ca55b9de8665 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.153914 Aug 31 11:47:21.563374 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 312/621] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:21 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:22.124522 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6f0f8c3b-46ba-41ee-bb0d-889b38066e76 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:22.125263 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6f0f8c3b-46ba-41ee-bb0d-889b38066e76 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:22.131812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6f0f8c3b-46ba-41ee-bb0d-889b38066e76 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:22.132291 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6f0f8c3b-46ba-41ee-bb0d-889b38066e76 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:22.132742 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6f0f8c3b-46ba-41ee-bb0d-889b38066e76 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:22.133428 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6f0f8c3b-46ba-41ee-bb0d-889b38066e76 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:22.133876 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6f0f8c3b-46ba-41ee-bb0d-889b38066e76 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:22.134294 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6f0f8c3b-46ba-41ee-bb0d-889b38066e76 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:22.269504 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6f0f8c3b-46ba-41ee-bb0d-889b38066e76 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:22.277599 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6f0f8c3b-46ba-41ee-bb0d-889b38066e76 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:22.279033 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6f0f8c3b-46ba-41ee-bb0d-889b38066e76 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:22.280177 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6f0f8c3b-46ba-41ee-bb0d-889b38066e76 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.159571 Aug 31 11:47:22.280766 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 310/622] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:22 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:22.374122 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3a886b7d-018a-4675-ac8f-156922fadc20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:22.374752 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3a886b7d-018a-4675-ac8f-156922fadc20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:22.381891 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a886b7d-018a-4675-ac8f-156922fadc20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:22.382367 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a886b7d-018a-4675-ac8f-156922fadc20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:22.382796 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a886b7d-018a-4675-ac8f-156922fadc20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:22.383478 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a886b7d-018a-4675-ac8f-156922fadc20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:22.383933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a886b7d-018a-4675-ac8f-156922fadc20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:22.384388 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a886b7d-018a-4675-ac8f-156922fadc20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:22.510039 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3a886b7d-018a-4675-ac8f-156922fadc20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:22.517619 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3a886b7d-018a-4675-ac8f-156922fadc20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.147366 Aug 31 11:47:22.518175 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 313/623] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:22 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:47:22.584974 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1c9b19d0-6fcf-46f3-87cc-86cc387be4d4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:22.586107 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1c9b19d0-6fcf-46f3-87cc-86cc387be4d4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:22.592042 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1c9b19d0-6fcf-46f3-87cc-86cc387be4d4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:22.592547 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1c9b19d0-6fcf-46f3-87cc-86cc387be4d4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:22.592988 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1c9b19d0-6fcf-46f3-87cc-86cc387be4d4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:22.593668 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1c9b19d0-6fcf-46f3-87cc-86cc387be4d4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:22.594112 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1c9b19d0-6fcf-46f3-87cc-86cc387be4d4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:22.594533 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1c9b19d0-6fcf-46f3-87cc-86cc387be4d4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:22.723772 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1c9b19d0-6fcf-46f3-87cc-86cc387be4d4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:22.731977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1c9b19d0-6fcf-46f3-87cc-86cc387be4d4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.150865 Aug 31 11:47:22.732550 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 311/624] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:22 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:23.302908 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9d725b02-2a41-4498-bf8b-622530382a91 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:23.303507 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9d725b02-2a41-4498-bf8b-622530382a91 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:23.309482 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9d725b02-2a41-4498-bf8b-622530382a91 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:23.309962 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9d725b02-2a41-4498-bf8b-622530382a91 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:23.310390 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9d725b02-2a41-4498-bf8b-622530382a91 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:23.311102 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9d725b02-2a41-4498-bf8b-622530382a91 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:23.311556 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9d725b02-2a41-4498-bf8b-622530382a91 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:23.311974 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9d725b02-2a41-4498-bf8b-622530382a91 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:23.449782 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9d725b02-2a41-4498-bf8b-622530382a91 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:23.458394 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9d725b02-2a41-4498-bf8b-622530382a91 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:23.459827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9d725b02-2a41-4498-bf8b-622530382a91 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:23.460984 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9d725b02-2a41-4498-bf8b-622530382a91 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.162582 Aug 31 11:47:23.461536 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 314/625] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:23 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:23.538037 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2b33a32d-a3ef-4e05-8b03-f0237645bd83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:23.538648 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2b33a32d-a3ef-4e05-8b03-f0237645bd83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:23.545102 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2b33a32d-a3ef-4e05-8b03-f0237645bd83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:23.545586 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2b33a32d-a3ef-4e05-8b03-f0237645bd83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:23.546019 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2b33a32d-a3ef-4e05-8b03-f0237645bd83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:23.546706 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2b33a32d-a3ef-4e05-8b03-f0237645bd83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:23.547157 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2b33a32d-a3ef-4e05-8b03-f0237645bd83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:23.547584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2b33a32d-a3ef-4e05-8b03-f0237645bd83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:23.678210 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2b33a32d-a3ef-4e05-8b03-f0237645bd83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:23.686173 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2b33a32d-a3ef-4e05-8b03-f0237645bd83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.152328 Aug 31 11:47:23.686762 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 312/626] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:23 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:23.753406 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5db1c805-5506-45e6-82b4-a8ab2e1eda19 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:23.753904 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5db1c805-5506-45e6-82b4-a8ab2e1eda19 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:23.761586 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5db1c805-5506-45e6-82b4-a8ab2e1eda19 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:23.762069 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5db1c805-5506-45e6-82b4-a8ab2e1eda19 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:23.762502 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5db1c805-5506-45e6-82b4-a8ab2e1eda19 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:23.763196 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5db1c805-5506-45e6-82b4-a8ab2e1eda19 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:23.763652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5db1c805-5506-45e6-82b4-a8ab2e1eda19 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:23.764075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5db1c805-5506-45e6-82b4-a8ab2e1eda19 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:23.894768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5db1c805-5506-45e6-82b4-a8ab2e1eda19 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:23.903595 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5db1c805-5506-45e6-82b4-a8ab2e1eda19 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.154102 Aug 31 11:47:23.904155 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 315/627] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:23 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:24.484050 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4a03f3de-84e5-44a7-9bd1-1c64cfd9cd92 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:24.484669 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4a03f3de-84e5-44a7-9bd1-1c64cfd9cd92 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:24.490827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4a03f3de-84e5-44a7-9bd1-1c64cfd9cd92 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:24.491297 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4a03f3de-84e5-44a7-9bd1-1c64cfd9cd92 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:24.491721 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4a03f3de-84e5-44a7-9bd1-1c64cfd9cd92 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:24.492409 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4a03f3de-84e5-44a7-9bd1-1c64cfd9cd92 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:24.492881 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4a03f3de-84e5-44a7-9bd1-1c64cfd9cd92 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:24.493295 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4a03f3de-84e5-44a7-9bd1-1c64cfd9cd92 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:24.621765 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4a03f3de-84e5-44a7-9bd1-1c64cfd9cd92 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:24.629852 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4a03f3de-84e5-44a7-9bd1-1c64cfd9cd92 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:24.631308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4a03f3de-84e5-44a7-9bd1-1c64cfd9cd92 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:24.632470 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4a03f3de-84e5-44a7-9bd1-1c64cfd9cd92 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.152281 Aug 31 11:47:24.633038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 313/628] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:24 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:24.707080 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-21df5aba-d35e-4856-a7b1-1f9739b3b492 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:24.708300 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-21df5aba-d35e-4856-a7b1-1f9739b3b492 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:24.714759 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21df5aba-d35e-4856-a7b1-1f9739b3b492 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:24.715228 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21df5aba-d35e-4856-a7b1-1f9739b3b492 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:24.715654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21df5aba-d35e-4856-a7b1-1f9739b3b492 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:24.716332 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21df5aba-d35e-4856-a7b1-1f9739b3b492 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:24.716807 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21df5aba-d35e-4856-a7b1-1f9739b3b492 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:24.717227 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21df5aba-d35e-4856-a7b1-1f9739b3b492 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:24.854523 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-21df5aba-d35e-4856-a7b1-1f9739b3b492 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:24.862076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-21df5aba-d35e-4856-a7b1-1f9739b3b492 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.158828 Aug 31 11:47:24.862626 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 316/629] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:24 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:24.928117 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c249ef29-8be6-43d1-9105-1b40aafcfee8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:24.929375 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c249ef29-8be6-43d1-9105-1b40aafcfee8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:24.937738 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c249ef29-8be6-43d1-9105-1b40aafcfee8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:24.938258 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c249ef29-8be6-43d1-9105-1b40aafcfee8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:24.938692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c249ef29-8be6-43d1-9105-1b40aafcfee8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:24.939391 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c249ef29-8be6-43d1-9105-1b40aafcfee8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:24.939844 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c249ef29-8be6-43d1-9105-1b40aafcfee8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:24.940269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c249ef29-8be6-43d1-9105-1b40aafcfee8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:25.074816 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c249ef29-8be6-43d1-9105-1b40aafcfee8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:25.085763 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c249ef29-8be6-43d1-9105-1b40aafcfee8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.164806 Aug 31 11:47:25.086379 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 314/630] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:24 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:25.655528 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1b5b3bfa-2df3-44f6-90eb-16d114774a2f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:25.656134 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1b5b3bfa-2df3-44f6-90eb-16d114774a2f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:25.662755 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1b5b3bfa-2df3-44f6-90eb-16d114774a2f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:25.663235 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1b5b3bfa-2df3-44f6-90eb-16d114774a2f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:25.663657 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1b5b3bfa-2df3-44f6-90eb-16d114774a2f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:25.664339 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1b5b3bfa-2df3-44f6-90eb-16d114774a2f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:25.664812 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1b5b3bfa-2df3-44f6-90eb-16d114774a2f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:25.665230 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1b5b3bfa-2df3-44f6-90eb-16d114774a2f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:25.821103 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1b5b3bfa-2df3-44f6-90eb-16d114774a2f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:25.826565 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1b5b3bfa-2df3-44f6-90eb-16d114774a2f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:25.828006 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1b5b3bfa-2df3-44f6-90eb-16d114774a2f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:25.829202 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1b5b3bfa-2df3-44f6-90eb-16d114774a2f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.177854 Aug 31 11:47:25.829760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 317/631] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:25 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:25.883310 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0a12f962-250e-4385-8804-287fc17e391f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:25.883919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0a12f962-250e-4385-8804-287fc17e391f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:25.890433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a12f962-250e-4385-8804-287fc17e391f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:25.890917 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a12f962-250e-4385-8804-287fc17e391f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:25.891352 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a12f962-250e-4385-8804-287fc17e391f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:25.892042 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a12f962-250e-4385-8804-287fc17e391f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:25.892512 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a12f962-250e-4385-8804-287fc17e391f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:25.892944 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a12f962-250e-4385-8804-287fc17e391f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:25.908533 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:26.033727 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0a12f962-250e-4385-8804-287fc17e391f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:26.041572 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0a12f962-250e-4385-8804-287fc17e391f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.162840 Aug 31 11:47:26.042142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 315/632] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:25 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:26.106421 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5f85c3f3-2823-4e81-b8af-5c940931cf7e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:26.107030 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5f85c3f3-2823-4e81-b8af-5c940931cf7e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:26.113133 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f85c3f3-2823-4e81-b8af-5c940931cf7e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:26.114191 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f85c3f3-2823-4e81-b8af-5c940931cf7e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:26.114748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f85c3f3-2823-4e81-b8af-5c940931cf7e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:26.115465 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f85c3f3-2823-4e81-b8af-5c940931cf7e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:26.115920 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f85c3f3-2823-4e81-b8af-5c940931cf7e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:26.116342 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5f85c3f3-2823-4e81-b8af-5c940931cf7e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:26.245415 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5f85c3f3-2823-4e81-b8af-5c940931cf7e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:26.249589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:26.257362 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5f85c3f3-2823-4e81-b8af-5c940931cf7e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.154807 Aug 31 11:47:26.257933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 318/633] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:26 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:26.853170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-45b01794-22b8-4aab-a534-46a03b53b8fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:26.853768 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-45b01794-22b8-4aab-a534-46a03b53b8fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:26.859686 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45b01794-22b8-4aab-a534-46a03b53b8fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:26.860158 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45b01794-22b8-4aab-a534-46a03b53b8fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:26.860672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45b01794-22b8-4aab-a534-46a03b53b8fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:26.861351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45b01794-22b8-4aab-a534-46a03b53b8fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:26.861791 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45b01794-22b8-4aab-a534-46a03b53b8fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:26.862204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45b01794-22b8-4aab-a534-46a03b53b8fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:26.994769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-45b01794-22b8-4aab-a534-46a03b53b8fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:27.002907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-45b01794-22b8-4aab-a534-46a03b53b8fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:27.004456 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-45b01794-22b8-4aab-a534-46a03b53b8fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:27.005766 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-45b01794-22b8-4aab-a534-46a03b53b8fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.156553 Aug 31 11:47:27.006336 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 316/634] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:26 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:27.062252 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-be463658-ceea-42dd-b1ac-c3929e0729ac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:27.062849 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-be463658-ceea-42dd-b1ac-c3929e0729ac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:27.069615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-be463658-ceea-42dd-b1ac-c3929e0729ac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:27.070087 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-be463658-ceea-42dd-b1ac-c3929e0729ac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:27.070521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-be463658-ceea-42dd-b1ac-c3929e0729ac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:27.071193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-be463658-ceea-42dd-b1ac-c3929e0729ac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:27.071664 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-be463658-ceea-42dd-b1ac-c3929e0729ac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:27.072080 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-be463658-ceea-42dd-b1ac-c3929e0729ac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:27.209962 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-be463658-ceea-42dd-b1ac-c3929e0729ac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:27.218142 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-be463658-ceea-42dd-b1ac-c3929e0729ac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.159636 Aug 31 11:47:27.218714 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 319/635] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:27 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:27.278508 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7d049b20-e2a1-40d6-9c1a-2e64254ccc6d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:27.279118 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-7d049b20-e2a1-40d6-9c1a-2e64254ccc6d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:27.285045 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d049b20-e2a1-40d6-9c1a-2e64254ccc6d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:27.286052 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d049b20-e2a1-40d6-9c1a-2e64254ccc6d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:27.286550 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d049b20-e2a1-40d6-9c1a-2e64254ccc6d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:27.287237 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d049b20-e2a1-40d6-9c1a-2e64254ccc6d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:27.287691 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d049b20-e2a1-40d6-9c1a-2e64254ccc6d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:27.288121 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d049b20-e2a1-40d6-9c1a-2e64254ccc6d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:27.417042 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7d049b20-e2a1-40d6-9c1a-2e64254ccc6d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:27.425118 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-7d049b20-e2a1-40d6-9c1a-2e64254ccc6d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.150516 Aug 31 11:47:27.425682 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 317/636] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:27 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:28.029641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7429ca7f-65da-4cc9-af0b-a64d7dc50242 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:28.030176 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7429ca7f-65da-4cc9-af0b-a64d7dc50242 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:28.036713 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7429ca7f-65da-4cc9-af0b-a64d7dc50242 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:28.037199 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7429ca7f-65da-4cc9-af0b-a64d7dc50242 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:28.037638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7429ca7f-65da-4cc9-af0b-a64d7dc50242 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:28.038331 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7429ca7f-65da-4cc9-af0b-a64d7dc50242 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:28.038781 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7429ca7f-65da-4cc9-af0b-a64d7dc50242 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:28.039210 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7429ca7f-65da-4cc9-af0b-a64d7dc50242 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:28.175802 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7429ca7f-65da-4cc9-af0b-a64d7dc50242 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:28.184214 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7429ca7f-65da-4cc9-af0b-a64d7dc50242 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:28.185699 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7429ca7f-65da-4cc9-af0b-a64d7dc50242 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:28.186853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7429ca7f-65da-4cc9-af0b-a64d7dc50242 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.161210 Aug 31 11:47:28.187407 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 320/637] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:28 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:47:28.240018 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c5baeae6-1e17-4bde-8623-36629629f20b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:28.240696 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c5baeae6-1e17-4bde-8623-36629629f20b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:28.247721 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5baeae6-1e17-4bde-8623-36629629f20b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:28.248348 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5baeae6-1e17-4bde-8623-36629629f20b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:28.248844 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5baeae6-1e17-4bde-8623-36629629f20b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:28.249547 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5baeae6-1e17-4bde-8623-36629629f20b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:28.249997 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5baeae6-1e17-4bde-8623-36629629f20b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:28.250416 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c5baeae6-1e17-4bde-8623-36629629f20b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:28.396472 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c5baeae6-1e17-4bde-8623-36629629f20b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:28.404176 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c5baeae6-1e17-4bde-8623-36629629f20b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.168612 Aug 31 11:47:28.404777 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 318/638] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:28 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:28.429247 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-cd4bb300-78b6-4b83-a573-957ee458556a req-d1c7020c-ec3b-44c8-91e5-767a64e718ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89973a85-9500-443c-b017-ceeb73cfc3be", "name": "network-vif-plugged", "status": "completed", "tag": "297bf55c-ede0-4ca0-8f41-ab94a1b08c26"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:47:28.439082 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-cd4bb300-78b6-4b83-a573-957ee458556a req-d1c7020c-ec3b-44c8-91e5-767a64e718ce service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:28.439560 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-cd4bb300-78b6-4b83-a573-957ee458556a req-d1c7020c-ec3b-44c8-91e5-767a64e718ce service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:28.440167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-cd4bb300-78b6-4b83-a573-957ee458556a req-d1c7020c-ec3b-44c8-91e5-767a64e718ce service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:28.450646 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cea42d60-a24d-47e5-ae61-e1324f1d2502 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:28.451317 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cea42d60-a24d-47e5-ae61-e1324f1d2502 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:28.456606 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-cd4bb300-78b6-4b83-a573-957ee458556a req-d1c7020c-ec3b-44c8-91e5-767a64e718ce service nova] Creating event network-vif-plugged:297bf55c-ede0-4ca0-8f41-ab94a1b08c26 for instance 89973a85-9500-443c-b017-ceeb73cfc3be on hv-cinder-83976 Aug 31 11:47:28.457769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cea42d60-a24d-47e5-ae61-e1324f1d2502 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:28.458264 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cea42d60-a24d-47e5-ae61-e1324f1d2502 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:28.458684 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cea42d60-a24d-47e5-ae61-e1324f1d2502 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:28.459413 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cea42d60-a24d-47e5-ae61-e1324f1d2502 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:28.459857 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cea42d60-a24d-47e5-ae61-e1324f1d2502 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:28.460472 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cea42d60-a24d-47e5-ae61-e1324f1d2502 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:28.461791 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-cd4bb300-78b6-4b83-a573-957ee458556a req-d1c7020c-ec3b-44c8-91e5-767a64e718ce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037000 Aug 31 11:47:28.462826 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 321/639] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:47:28.590433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cea42d60-a24d-47e5-ae61-e1324f1d2502 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:28.599416 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cea42d60-a24d-47e5-ae61-e1324f1d2502 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.154407 Aug 31 11:47:28.599985 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 319/640] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:28 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:29.212833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2932150d-839b-4b56-b864-62ff2a9b4c57 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:29.213531 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2932150d-839b-4b56-b864-62ff2a9b4c57 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:29.219627 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2932150d-839b-4b56-b864-62ff2a9b4c57 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:29.220101 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2932150d-839b-4b56-b864-62ff2a9b4c57 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:29.220561 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2932150d-839b-4b56-b864-62ff2a9b4c57 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:29.221247 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2932150d-839b-4b56-b864-62ff2a9b4c57 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:29.221696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2932150d-839b-4b56-b864-62ff2a9b4c57 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:29.222116 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2932150d-839b-4b56-b864-62ff2a9b4c57 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:29.355585 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2932150d-839b-4b56-b864-62ff2a9b4c57 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:29.363524 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2932150d-839b-4b56-b864-62ff2a9b4c57 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:29.365028 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2932150d-839b-4b56-b864-62ff2a9b4c57 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:29.366175 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2932150d-839b-4b56-b864-62ff2a9b4c57 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.158808 Aug 31 11:47:29.366723 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 322/641] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:29 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:29.423753 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ae7a79d2-65f1-415c-9d22-0c543aa9647c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:29.424366 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ae7a79d2-65f1-415c-9d22-0c543aa9647c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:29.430605 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ae7a79d2-65f1-415c-9d22-0c543aa9647c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:29.431089 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ae7a79d2-65f1-415c-9d22-0c543aa9647c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:29.431525 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ae7a79d2-65f1-415c-9d22-0c543aa9647c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:29.432241 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ae7a79d2-65f1-415c-9d22-0c543aa9647c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:29.432726 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ae7a79d2-65f1-415c-9d22-0c543aa9647c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:29.433150 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ae7a79d2-65f1-415c-9d22-0c543aa9647c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:29.573154 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ae7a79d2-65f1-415c-9d22-0c543aa9647c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:29.584289 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ae7a79d2-65f1-415c-9d22-0c543aa9647c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.164350 Aug 31 11:47:29.584977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 320/642] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:29 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:29.619668 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7224ee3d-d02f-457c-9ce9-a8b77d3eccf4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:29.620273 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7224ee3d-d02f-457c-9ce9-a8b77d3eccf4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:29.626186 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7224ee3d-d02f-457c-9ce9-a8b77d3eccf4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:29.626666 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7224ee3d-d02f-457c-9ce9-a8b77d3eccf4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:29.627099 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7224ee3d-d02f-457c-9ce9-a8b77d3eccf4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:29.627787 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7224ee3d-d02f-457c-9ce9-a8b77d3eccf4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:29.628269 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7224ee3d-d02f-457c-9ce9-a8b77d3eccf4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:29.628728 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7224ee3d-d02f-457c-9ce9-a8b77d3eccf4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:29.759160 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7224ee3d-d02f-457c-9ce9-a8b77d3eccf4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:29.767367 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7224ee3d-d02f-457c-9ce9-a8b77d3eccf4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.151442 Aug 31 11:47:29.767868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 323/643] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:29 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:30.389898 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d309f0e3-2518-43b6-a544-0081805ac3de tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:30.390446 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d309f0e3-2518-43b6-a544-0081805ac3de tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:30.396769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d309f0e3-2518-43b6-a544-0081805ac3de tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:30.397255 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d309f0e3-2518-43b6-a544-0081805ac3de tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:30.397688 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d309f0e3-2518-43b6-a544-0081805ac3de tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:30.398369 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d309f0e3-2518-43b6-a544-0081805ac3de tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:30.398820 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d309f0e3-2518-43b6-a544-0081805ac3de tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:30.399238 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d309f0e3-2518-43b6-a544-0081805ac3de tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:30.529579 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d309f0e3-2518-43b6-a544-0081805ac3de tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:30.538056 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d309f0e3-2518-43b6-a544-0081805ac3de tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:30.539479 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d309f0e3-2518-43b6-a544-0081805ac3de tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:30.540645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d309f0e3-2518-43b6-a544-0081805ac3de tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.154760 Aug 31 11:47:30.541283 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 321/644] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:30 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:30.605080 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5635ff8e-3178-4094-851e-7973aca76d1b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:30.605685 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5635ff8e-3178-4094-851e-7973aca76d1b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:30.612136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5635ff8e-3178-4094-851e-7973aca76d1b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:30.612643 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5635ff8e-3178-4094-851e-7973aca76d1b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:30.613077 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5635ff8e-3178-4094-851e-7973aca76d1b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:30.614041 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5635ff8e-3178-4094-851e-7973aca76d1b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:30.614494 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5635ff8e-3178-4094-851e-7973aca76d1b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:30.614918 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5635ff8e-3178-4094-851e-7973aca76d1b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:30.747266 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5635ff8e-3178-4094-851e-7973aca76d1b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:30.755049 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5635ff8e-3178-4094-851e-7973aca76d1b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.153633 Aug 31 11:47:30.755615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 324/645] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:30 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:30.788509 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-da1691a9-dad7-40b1-b7c4-a082ad4bd95e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:30.789155 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-da1691a9-dad7-40b1-b7c4-a082ad4bd95e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:30.795021 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da1691a9-dad7-40b1-b7c4-a082ad4bd95e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:30.795501 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da1691a9-dad7-40b1-b7c4-a082ad4bd95e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:30.795934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da1691a9-dad7-40b1-b7c4-a082ad4bd95e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:30.796715 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da1691a9-dad7-40b1-b7c4-a082ad4bd95e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:30.797166 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da1691a9-dad7-40b1-b7c4-a082ad4bd95e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:30.797588 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da1691a9-dad7-40b1-b7c4-a082ad4bd95e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:30.928742 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-da1691a9-dad7-40b1-b7c4-a082ad4bd95e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:30.937053 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-da1691a9-dad7-40b1-b7c4-a082ad4bd95e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.152906 Aug 31 11:47:30.937553 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 322/646] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:30 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:31.562955 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c0c71d3b-1bc1-4768-aebd-1b37a733ec0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:31.563562 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c0c71d3b-1bc1-4768-aebd-1b37a733ec0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:31.570858 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0c71d3b-1bc1-4768-aebd-1b37a733ec0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:31.571338 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0c71d3b-1bc1-4768-aebd-1b37a733ec0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:31.571774 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0c71d3b-1bc1-4768-aebd-1b37a733ec0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:31.572456 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0c71d3b-1bc1-4768-aebd-1b37a733ec0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:31.572930 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0c71d3b-1bc1-4768-aebd-1b37a733ec0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:31.573356 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0c71d3b-1bc1-4768-aebd-1b37a733ec0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:31.701916 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c0c71d3b-1bc1-4768-aebd-1b37a733ec0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:31.710346 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c0c71d3b-1bc1-4768-aebd-1b37a733ec0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:31.711878 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c0c71d3b-1bc1-4768-aebd-1b37a733ec0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:31.713042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c0c71d3b-1bc1-4768-aebd-1b37a733ec0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.154049 Aug 31 11:47:31.713594 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 325/647] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:31 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:31.774779 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9554da0e-4048-4090-8ae2-a19db457071d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:31.775378 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9554da0e-4048-4090-8ae2-a19db457071d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:31.781755 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9554da0e-4048-4090-8ae2-a19db457071d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:31.782230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9554da0e-4048-4090-8ae2-a19db457071d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:31.782653 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9554da0e-4048-4090-8ae2-a19db457071d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:31.783322 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9554da0e-4048-4090-8ae2-a19db457071d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:31.783765 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9554da0e-4048-4090-8ae2-a19db457071d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:31.784179 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9554da0e-4048-4090-8ae2-a19db457071d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:31.913042 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9554da0e-4048-4090-8ae2-a19db457071d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:31.920562 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9554da0e-4048-4090-8ae2-a19db457071d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.149575 Aug 31 11:47:31.921119 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 323/648] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:31 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:31.959066 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d1be1b98-1f62-43a7-8db3-1c829afebccf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:31.959659 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d1be1b98-1f62-43a7-8db3-1c829afebccf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:31.965581 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d1be1b98-1f62-43a7-8db3-1c829afebccf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:31.965997 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d1be1b98-1f62-43a7-8db3-1c829afebccf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:31.966427 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d1be1b98-1f62-43a7-8db3-1c829afebccf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:31.967104 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d1be1b98-1f62-43a7-8db3-1c829afebccf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:31.967548 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d1be1b98-1f62-43a7-8db3-1c829afebccf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:31.967963 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d1be1b98-1f62-43a7-8db3-1c829afebccf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:32.095402 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d1be1b98-1f62-43a7-8db3-1c829afebccf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:32.104354 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d1be1b98-1f62-43a7-8db3-1c829afebccf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.149656 Aug 31 11:47:32.104940 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 326/649] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:31 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:32.686781 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-bc9579c4-699e-4696-a711-cbf30615d508 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:32.687382 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-bc9579c4-699e-4696-a711-cbf30615d508 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:32.694307 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc9579c4-699e-4696-a711-cbf30615d508 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:32.694783 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc9579c4-699e-4696-a711-cbf30615d508 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:32.695203 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc9579c4-699e-4696-a711-cbf30615d508 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:32.695874 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc9579c4-699e-4696-a711-cbf30615d508 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:32.696314 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc9579c4-699e-4696-a711-cbf30615d508 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:32.696757 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc9579c4-699e-4696-a711-cbf30615d508 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:32.735641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6b685429-af35-448d-8cd7-65ff88a037ac tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:32.736269 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6b685429-af35-448d-8cd7-65ff88a037ac tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:32.743195 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6b685429-af35-448d-8cd7-65ff88a037ac tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:32.743680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6b685429-af35-448d-8cd7-65ff88a037ac tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:32.744112 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6b685429-af35-448d-8cd7-65ff88a037ac tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:32.744833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6b685429-af35-448d-8cd7-65ff88a037ac tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:32.745280 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6b685429-af35-448d-8cd7-65ff88a037ac tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:32.745704 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6b685429-af35-448d-8cd7-65ff88a037ac tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:32.830027 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-bc9579c4-699e-4696-a711-cbf30615d508 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:32.841884 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-bc9579c4-699e-4696-a711-cbf30615d508 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1594 microversion: 2.1 time: 0.158791 Aug 31 11:47:32.842574 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 324/650] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:32 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:32.878977 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6b685429-af35-448d-8cd7-65ff88a037ac tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:32.888161 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6b685429-af35-448d-8cd7-65ff88a037ac tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:32.889632 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6b685429-af35-448d-8cd7-65ff88a037ac tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:32.890785 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6b685429-af35-448d-8cd7-65ff88a037ac tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.159023 Aug 31 11:47:32.891343 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 327/651] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:32 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:47:32.942412 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8f503d8c-7ded-49e3-9047-cf943ac86755 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:32.943026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8f503d8c-7ded-49e3-9047-cf943ac86755 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:32.948811 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8f503d8c-7ded-49e3-9047-cf943ac86755 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:32.949293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8f503d8c-7ded-49e3-9047-cf943ac86755 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:32.949725 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8f503d8c-7ded-49e3-9047-cf943ac86755 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:32.950410 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8f503d8c-7ded-49e3-9047-cf943ac86755 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:32.950860 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8f503d8c-7ded-49e3-9047-cf943ac86755 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:32.951283 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8f503d8c-7ded-49e3-9047-cf943ac86755 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:33.114812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8f503d8c-7ded-49e3-9047-cf943ac86755 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:33.123010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8f503d8c-7ded-49e3-9047-cf943ac86755 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.185209 Aug 31 11:47:33.125315 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-06c2008f-e8d8-40e9-9fda-61803c3b283c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:33.126003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-06c2008f-e8d8-40e9-9fda-61803c3b283c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:33.131848 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 325/652] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:32 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:33.132692 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-06c2008f-e8d8-40e9-9fda-61803c3b283c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:33.133181 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-06c2008f-e8d8-40e9-9fda-61803c3b283c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:33.133622 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-06c2008f-e8d8-40e9-9fda-61803c3b283c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:33.134307 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-06c2008f-e8d8-40e9-9fda-61803c3b283c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:33.134757 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-06c2008f-e8d8-40e9-9fda-61803c3b283c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:33.135182 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-06c2008f-e8d8-40e9-9fda-61803c3b283c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:33.355649 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-06c2008f-e8d8-40e9-9fda-61803c3b283c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:33.364372 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-06c2008f-e8d8-40e9-9fda-61803c3b283c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.242348 Aug 31 11:47:33.365359 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 328/653] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:33 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:47:33.914889 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7b39b390-782f-46f1-bef4-20b6744eb422 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:33.915602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-7b39b390-782f-46f1-bef4-20b6744eb422 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:33.922006 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b39b390-782f-46f1-bef4-20b6744eb422 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:33.922562 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b39b390-782f-46f1-bef4-20b6744eb422 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:33.922995 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b39b390-782f-46f1-bef4-20b6744eb422 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:33.923685 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b39b390-782f-46f1-bef4-20b6744eb422 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:33.924129 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b39b390-782f-46f1-bef4-20b6744eb422 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:33.924704 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7b39b390-782f-46f1-bef4-20b6744eb422 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:34.058415 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7b39b390-782f-46f1-bef4-20b6744eb422 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:34.067291 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7b39b390-782f-46f1-bef4-20b6744eb422 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:34.068795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7b39b390-782f-46f1-bef4-20b6744eb422 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:34.069959 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-7b39b390-782f-46f1-bef4-20b6744eb422 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.159000 Aug 31 11:47:34.070531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 326/654] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:33 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:34.143369 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-60c1d3d7-f4cd-4dce-8c60-d5ce8a093b8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:34.144333 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-60c1d3d7-f4cd-4dce-8c60-d5ce8a093b8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:34.151986 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-60c1d3d7-f4cd-4dce-8c60-d5ce8a093b8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:34.152474 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-60c1d3d7-f4cd-4dce-8c60-d5ce8a093b8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:34.152943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-60c1d3d7-f4cd-4dce-8c60-d5ce8a093b8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:34.154182 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-60c1d3d7-f4cd-4dce-8c60-d5ce8a093b8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:34.155025 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-60c1d3d7-f4cd-4dce-8c60-d5ce8a093b8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:34.155805 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-60c1d3d7-f4cd-4dce-8c60-d5ce8a093b8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:34.350880 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-60c1d3d7-f4cd-4dce-8c60-d5ce8a093b8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:34.358818 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-60c1d3d7-f4cd-4dce-8c60-d5ce8a093b8d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.219064 Aug 31 11:47:34.359402 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 329/655] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:34 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:34.385975 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ad884ee7-23d2-4d78-80e5-0c377dd42e90 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:34.386698 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ad884ee7-23d2-4d78-80e5-0c377dd42e90 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:34.392775 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ad884ee7-23d2-4d78-80e5-0c377dd42e90 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:34.393273 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ad884ee7-23d2-4d78-80e5-0c377dd42e90 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:34.393708 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ad884ee7-23d2-4d78-80e5-0c377dd42e90 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:34.394413 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ad884ee7-23d2-4d78-80e5-0c377dd42e90 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:34.395445 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ad884ee7-23d2-4d78-80e5-0c377dd42e90 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:34.395928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ad884ee7-23d2-4d78-80e5-0c377dd42e90 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:34.533930 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ad884ee7-23d2-4d78-80e5-0c377dd42e90 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:34.543169 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ad884ee7-23d2-4d78-80e5-0c377dd42e90 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.161046 Aug 31 11:47:34.543842 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 327/656] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:34 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:35.042279 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-260a1e39-741f-4c7e-aeb2-3e593ea0d7f3 req-27e88b24-7a2c-48bf-a99d-db0c6a965824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30732ac7-790c-4585-9d27-a723b4a49095", "tag": "008c8ca4-7cac-42b6-9966-a441e62ec36a"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:47:35.051870 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-260a1e39-741f-4c7e-aeb2-3e593ea0d7f3 req-27e88b24-7a2c-48bf-a99d-db0c6a965824 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:35.052349 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-260a1e39-741f-4c7e-aeb2-3e593ea0d7f3 req-27e88b24-7a2c-48bf-a99d-db0c6a965824 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:35.052814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-260a1e39-741f-4c7e-aeb2-3e593ea0d7f3 req-27e88b24-7a2c-48bf-a99d-db0c6a965824 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:35.064281 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-260a1e39-741f-4c7e-aeb2-3e593ea0d7f3 req-27e88b24-7a2c-48bf-a99d-db0c6a965824 service nova] Creating event network-changed:008c8ca4-7cac-42b6-9966-a441e62ec36a for instance 30732ac7-790c-4585-9d27-a723b4a49095 on hv-cinder-83976 Aug 31 11:47:35.069691 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-260a1e39-741f-4c7e-aeb2-3e593ea0d7f3 req-27e88b24-7a2c-48bf-a99d-db0c6a965824 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030943 Aug 31 11:47:35.070329 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 330/657] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:47:35.094876 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0b706ecb-4425-4f8f-a2bf-081e4e1cdd55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:35.096175 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0b706ecb-4425-4f8f-a2bf-081e4e1cdd55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:35.104060 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b706ecb-4425-4f8f-a2bf-081e4e1cdd55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:35.104696 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b706ecb-4425-4f8f-a2bf-081e4e1cdd55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:35.105198 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b706ecb-4425-4f8f-a2bf-081e4e1cdd55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:35.105991 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b706ecb-4425-4f8f-a2bf-081e4e1cdd55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:35.106508 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b706ecb-4425-4f8f-a2bf-081e4e1cdd55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:35.107167 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b706ecb-4425-4f8f-a2bf-081e4e1cdd55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:35.314190 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0b706ecb-4425-4f8f-a2bf-081e4e1cdd55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:35.323473 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0b706ecb-4425-4f8f-a2bf-081e4e1cdd55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:35.324942 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0b706ecb-4425-4f8f-a2bf-081e4e1cdd55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:35.326102 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0b706ecb-4425-4f8f-a2bf-081e4e1cdd55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.236124 Aug 31 11:47:35.326655 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 328/658] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:35 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:35.382164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5a73e76a-795c-49de-a548-b5408f6738b6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:35.383159 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5a73e76a-795c-49de-a548-b5408f6738b6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:35.390705 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5a73e76a-795c-49de-a548-b5408f6738b6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:35.391629 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5a73e76a-795c-49de-a548-b5408f6738b6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:35.392222 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5a73e76a-795c-49de-a548-b5408f6738b6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:35.393444 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5a73e76a-795c-49de-a548-b5408f6738b6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:35.394053 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5a73e76a-795c-49de-a548-b5408f6738b6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:35.394684 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5a73e76a-795c-49de-a548-b5408f6738b6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:35.567301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a98ac3b3-afcc-4e09-9856-d064d6674d5d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:35.567700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a98ac3b3-afcc-4e09-9856-d064d6674d5d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:35.575181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a98ac3b3-afcc-4e09-9856-d064d6674d5d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:35.575949 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a98ac3b3-afcc-4e09-9856-d064d6674d5d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:35.576436 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a98ac3b3-afcc-4e09-9856-d064d6674d5d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:35.577196 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a98ac3b3-afcc-4e09-9856-d064d6674d5d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:35.577915 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a98ac3b3-afcc-4e09-9856-d064d6674d5d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:35.578726 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a98ac3b3-afcc-4e09-9856-d064d6674d5d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:35.616619 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5a73e76a-795c-49de-a548-b5408f6738b6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:35.626637 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5a73e76a-795c-49de-a548-b5408f6738b6 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.248691 Aug 31 11:47:35.641307 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 331/659] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:35 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:35.723192 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a98ac3b3-afcc-4e09-9856-d064d6674d5d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:35.732875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a98ac3b3-afcc-4e09-9856-d064d6674d5d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.171827 Aug 31 11:47:35.734088 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 329/660] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:35 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:47:36.194068 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ef211470-4f21-45c0-87c3-a52dcc168aa2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-452833918"}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:47:36.194531 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ef211470-4f21-45c0-87c3-a52dcc168aa2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:36.200615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ef211470-4f21-45c0-87c3-a52dcc168aa2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:36.201101 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ef211470-4f21-45c0-87c3-a52dcc168aa2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:36.201566 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ef211470-4f21-45c0-87c3-a52dcc168aa2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:36.202257 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ef211470-4f21-45c0-87c3-a52dcc168aa2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:36.202888 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ef211470-4f21-45c0-87c3-a52dcc168aa2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:36.203307 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ef211470-4f21-45c0-87c3-a52dcc168aa2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:36.337052 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.network.security_group_api [None req-ef211470-4f21-45c0-87c3-a52dcc168aa2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Adding security group ae3abcca-3884-4cf0-abaf-c85fbd6df12d to port 008c8ca4-7cac-42b6-9966-a441e62ec36a Aug 31 11:47:36.349331 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5ce7557a-8fe8-4661-b42e-808d9271b2af tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:36.349927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5ce7557a-8fe8-4661-b42e-808d9271b2af tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:36.359046 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ce7557a-8fe8-4661-b42e-808d9271b2af tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:36.359544 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ce7557a-8fe8-4661-b42e-808d9271b2af tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:36.359978 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ce7557a-8fe8-4661-b42e-808d9271b2af tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:36.360721 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ce7557a-8fe8-4661-b42e-808d9271b2af tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:36.361175 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ce7557a-8fe8-4661-b42e-808d9271b2af tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:36.361601 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ce7557a-8fe8-4661-b42e-808d9271b2af tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:36.527628 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5ce7557a-8fe8-4661-b42e-808d9271b2af tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:36.541107 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5ce7557a-8fe8-4661-b42e-808d9271b2af tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:36.542745 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5ce7557a-8fe8-4661-b42e-808d9271b2af tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:36.544061 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5ce7557a-8fe8-4661-b42e-808d9271b2af tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1746 microversion: 2.20 time: 0.198559 Aug 31 11:47:36.544890 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 330/661] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:36 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1746 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:36.651288 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-fb4d0aa9-15d6-443a-b628-95208b3822d4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:36.652996 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-fb4d0aa9-15d6-443a-b628-95208b3822d4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:36.665152 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fb4d0aa9-15d6-443a-b628-95208b3822d4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:36.665637 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fb4d0aa9-15d6-443a-b628-95208b3822d4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:36.666269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fb4d0aa9-15d6-443a-b628-95208b3822d4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:36.666974 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fb4d0aa9-15d6-443a-b628-95208b3822d4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:36.667424 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fb4d0aa9-15d6-443a-b628-95208b3822d4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:36.667845 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fb4d0aa9-15d6-443a-b628-95208b3822d4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:36.742505 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ef211470-4f21-45c0-87c3-a52dcc168aa2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "POST /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/action" status: 202 len: 0 microversion: 2.1 time: 0.553145 Aug 31 11:47:36.746564 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 332/662] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 31 11:47:36 2022] POST /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:47:36.754002 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-36fd0a3f-3932-4d82-b7aa-22b064bf1fd5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:36.754619 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-36fd0a3f-3932-4d82-b7aa-22b064bf1fd5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:36.779915 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-36fd0a3f-3932-4d82-b7aa-22b064bf1fd5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:36.780636 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-36fd0a3f-3932-4d82-b7aa-22b064bf1fd5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:36.781089 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-36fd0a3f-3932-4d82-b7aa-22b064bf1fd5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:36.781826 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-36fd0a3f-3932-4d82-b7aa-22b064bf1fd5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:36.782277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-36fd0a3f-3932-4d82-b7aa-22b064bf1fd5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:36.782895 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-36fd0a3f-3932-4d82-b7aa-22b064bf1fd5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:36.987528 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-36fd0a3f-3932-4d82-b7aa-22b064bf1fd5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:36.996775 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-36fd0a3f-3932-4d82-b7aa-22b064bf1fd5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1640 microversion: 2.1 time: 0.246501 Aug 31 11:47:36.997671 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 333/663] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:36 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1640 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:37.002472 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-602f0db3-6d64-49d6-8044-3257b8fb73a3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:37.003288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-602f0db3-6d64-49d6-8044-3257b8fb73a3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:37.010131 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-602f0db3-6d64-49d6-8044-3257b8fb73a3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:37.010899 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-602f0db3-6d64-49d6-8044-3257b8fb73a3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:37.011516 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-602f0db3-6d64-49d6-8044-3257b8fb73a3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:37.013257 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-602f0db3-6d64-49d6-8044-3257b8fb73a3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:37.013914 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-602f0db3-6d64-49d6-8044-3257b8fb73a3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:37.014525 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-602f0db3-6d64-49d6-8044-3257b8fb73a3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:37.142289 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-fb4d0aa9-15d6-443a-b628-95208b3822d4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:37.152138 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-fb4d0aa9-15d6-443a-b628-95208b3822d4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1367 microversion: 2.1 time: 0.508729 Aug 31 11:47:37.152772 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 331/664] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:36 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1367 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:47:37.158044 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-812a6e2e-6e51-4366-99df-7c0f66880b90 req-dd82bc34-7d7d-4b0c-b8f7-532525c7d27a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30732ac7-790c-4585-9d27-a723b4a49095", "tag": "008c8ca4-7cac-42b6-9966-a441e62ec36a"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:47:37.170222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-812a6e2e-6e51-4366-99df-7c0f66880b90 req-dd82bc34-7d7d-4b0c-b8f7-532525c7d27a service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:37.170704 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-812a6e2e-6e51-4366-99df-7c0f66880b90 req-dd82bc34-7d7d-4b0c-b8f7-532525c7d27a service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:37.171220 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-812a6e2e-6e51-4366-99df-7c0f66880b90 req-dd82bc34-7d7d-4b0c-b8f7-532525c7d27a service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:37.175490 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:37.183173 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-602f0db3-6d64-49d6-8044-3257b8fb73a3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:37.186337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-812a6e2e-6e51-4366-99df-7c0f66880b90 req-dd82bc34-7d7d-4b0c-b8f7-532525c7d27a service nova] Creating event network-changed:008c8ca4-7cac-42b6-9966-a441e62ec36a for instance 30732ac7-790c-4585-9d27-a723b4a49095 on hv-cinder-83976 Aug 31 11:47:37.191887 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-812a6e2e-6e51-4366-99df-7c0f66880b90 req-dd82bc34-7d7d-4b0c-b8f7-532525c7d27a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037277 Aug 31 11:47:37.192644 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 332/665] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:47:37.192868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-602f0db3-6d64-49d6-8044-3257b8fb73a3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.192937 Aug 31 11:47:37.193410 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 334/666] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:36 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:37.569742 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b7dedd47-a2f0-4348-946e-5b1624cdd449 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:37.570566 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b7dedd47-a2f0-4348-946e-5b1624cdd449 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:37.577543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b7dedd47-a2f0-4348-946e-5b1624cdd449 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:37.578090 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b7dedd47-a2f0-4348-946e-5b1624cdd449 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:37.578528 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b7dedd47-a2f0-4348-946e-5b1624cdd449 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:37.579222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b7dedd47-a2f0-4348-946e-5b1624cdd449 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:37.579669 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b7dedd47-a2f0-4348-946e-5b1624cdd449 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:37.580088 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b7dedd47-a2f0-4348-946e-5b1624cdd449 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:37.716125 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b7dedd47-a2f0-4348-946e-5b1624cdd449 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:37.725687 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b7dedd47-a2f0-4348-946e-5b1624cdd449 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:37.727108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b7dedd47-a2f0-4348-946e-5b1624cdd449 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:37.728241 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b7dedd47-a2f0-4348-946e-5b1624cdd449 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.163639 Aug 31 11:47:37.728815 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 333/667] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:37 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:38.173860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d92676c1-cdc8-400f-9417-ac3ed4d45175 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:38.174461 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d92676c1-cdc8-400f-9417-ac3ed4d45175 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:38.180899 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d92676c1-cdc8-400f-9417-ac3ed4d45175 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:38.181374 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d92676c1-cdc8-400f-9417-ac3ed4d45175 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:38.181797 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d92676c1-cdc8-400f-9417-ac3ed4d45175 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:38.182484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d92676c1-cdc8-400f-9417-ac3ed4d45175 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:38.182927 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d92676c1-cdc8-400f-9417-ac3ed4d45175 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:38.183341 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d92676c1-cdc8-400f-9417-ac3ed4d45175 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:38.217012 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7e2d74a1-8919-4590-a252-9c7bf8780bbf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:38.217614 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-7e2d74a1-8919-4590-a252-9c7bf8780bbf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:38.224233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e2d74a1-8919-4590-a252-9c7bf8780bbf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:38.224958 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e2d74a1-8919-4590-a252-9c7bf8780bbf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:38.225390 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e2d74a1-8919-4590-a252-9c7bf8780bbf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:38.226112 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e2d74a1-8919-4590-a252-9c7bf8780bbf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:38.226555 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e2d74a1-8919-4590-a252-9c7bf8780bbf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:38.226980 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7e2d74a1-8919-4590-a252-9c7bf8780bbf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:38.313370 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d92676c1-cdc8-400f-9417-ac3ed4d45175 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:38.321770 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d92676c1-cdc8-400f-9417-ac3ed4d45175 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1556 microversion: 2.1 time: 0.151671 Aug 31 11:47:38.322331 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 335/668] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:38 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:38.342010 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-38314166-a4ed-48c6-86d9-1c3b47ffcc83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:38.342501 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-38314166-a4ed-48c6-86d9-1c3b47ffcc83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:38.349808 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38314166-a4ed-48c6-86d9-1c3b47ffcc83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:38.350316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38314166-a4ed-48c6-86d9-1c3b47ffcc83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:38.350746 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38314166-a4ed-48c6-86d9-1c3b47ffcc83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:38.351434 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38314166-a4ed-48c6-86d9-1c3b47ffcc83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:38.351907 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38314166-a4ed-48c6-86d9-1c3b47ffcc83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:38.352323 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38314166-a4ed-48c6-86d9-1c3b47ffcc83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:38.364091 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7e2d74a1-8919-4590-a252-9c7bf8780bbf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:38.372884 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-7e2d74a1-8919-4590-a252-9c7bf8780bbf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.159501 Aug 31 11:47:38.373552 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 334/669] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:38 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:47:38.428176 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-38314166-a4ed-48c6-86d9-1c3b47ffcc83 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089780 Aug 31 11:47:38.428813 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 336/670] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 31 11:47:38 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:47:38.751258 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-83328dab-8445-4284-8160-b96a25ec5525 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:38.751866 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-83328dab-8445-4284-8160-b96a25ec5525 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:38.758377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-83328dab-8445-4284-8160-b96a25ec5525 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:38.758860 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-83328dab-8445-4284-8160-b96a25ec5525 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:38.759290 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-83328dab-8445-4284-8160-b96a25ec5525 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:38.759979 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-83328dab-8445-4284-8160-b96a25ec5525 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:38.760430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-83328dab-8445-4284-8160-b96a25ec5525 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:38.760882 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-83328dab-8445-4284-8160-b96a25ec5525 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:38.898551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-83328dab-8445-4284-8160-b96a25ec5525 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:38.906918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-83328dab-8445-4284-8160-b96a25ec5525 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:38.908353 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-83328dab-8445-4284-8160-b96a25ec5525 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:38.909533 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-83328dab-8445-4284-8160-b96a25ec5525 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.162217 Aug 31 11:47:38.910098 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 335/671] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:38 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:39.389216 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-bd839eaf-82ff-4ecd-b1d9-cf42890aab02 req-15f507f1-c054-4ff6-9480-fdb58cd90297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89973a85-9500-443c-b017-ceeb73cfc3be", "tag": "297bf55c-ede0-4ca0-8f41-ab94a1b08c26"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:47:39.394704 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-561f032d-0ddb-4ea9-a058-df59ca7187ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:39.395734 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-561f032d-0ddb-4ea9-a058-df59ca7187ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:39.398947 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-bd839eaf-82ff-4ecd-b1d9-cf42890aab02 req-15f507f1-c054-4ff6-9480-fdb58cd90297 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:39.399712 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-bd839eaf-82ff-4ecd-b1d9-cf42890aab02 req-15f507f1-c054-4ff6-9480-fdb58cd90297 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:39.399853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-bd839eaf-82ff-4ecd-b1d9-cf42890aab02 req-15f507f1-c054-4ff6-9480-fdb58cd90297 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:39.402272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-561f032d-0ddb-4ea9-a058-df59ca7187ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:39.402848 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-561f032d-0ddb-4ea9-a058-df59ca7187ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:39.403345 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-561f032d-0ddb-4ea9-a058-df59ca7187ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:39.404268 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-561f032d-0ddb-4ea9-a058-df59ca7187ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:39.404836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-561f032d-0ddb-4ea9-a058-df59ca7187ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:39.405374 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-561f032d-0ddb-4ea9-a058-df59ca7187ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:39.415428 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-bd839eaf-82ff-4ecd-b1d9-cf42890aab02 req-15f507f1-c054-4ff6-9480-fdb58cd90297 service nova] Creating event network-changed:297bf55c-ede0-4ca0-8f41-ab94a1b08c26 for instance 89973a85-9500-443c-b017-ceeb73cfc3be on hv-cinder-83976 Aug 31 11:47:39.420423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-bd839eaf-82ff-4ecd-b1d9-cf42890aab02 req-15f507f1-c054-4ff6-9480-fdb58cd90297 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035450 Aug 31 11:47:39.421384 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 337/672] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:47:39.545383 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-561f032d-0ddb-4ea9-a058-df59ca7187ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:39.554337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-561f032d-0ddb-4ea9-a058-df59ca7187ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.163403 Aug 31 11:47:39.554928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 336/673] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:39 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:39.934494 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f092f415-5068-443c-82c4-e44db340d1f5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:39.935103 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f092f415-5068-443c-82c4-e44db340d1f5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:39.941138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f092f415-5068-443c-82c4-e44db340d1f5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:39.942716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f092f415-5068-443c-82c4-e44db340d1f5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:39.943170 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f092f415-5068-443c-82c4-e44db340d1f5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:39.943868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f092f415-5068-443c-82c4-e44db340d1f5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:39.944324 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f092f415-5068-443c-82c4-e44db340d1f5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:39.944783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f092f415-5068-443c-82c4-e44db340d1f5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:39.948868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:40.082004 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f092f415-5068-443c-82c4-e44db340d1f5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:40.090661 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f092f415-5068-443c-82c4-e44db340d1f5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:40.092087 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f092f415-5068-443c-82c4-e44db340d1f5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:40.093273 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f092f415-5068-443c-82c4-e44db340d1f5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.163135 Aug 31 11:47:40.093832 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 338/674] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:39 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:40.578132 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8149356a-c39b-488d-95c5-06bf0decd51c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:40.578741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8149356a-c39b-488d-95c5-06bf0decd51c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:40.585398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8149356a-c39b-488d-95c5-06bf0decd51c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:40.585875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8149356a-c39b-488d-95c5-06bf0decd51c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:40.586310 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8149356a-c39b-488d-95c5-06bf0decd51c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:40.586992 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8149356a-c39b-488d-95c5-06bf0decd51c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:40.587442 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8149356a-c39b-488d-95c5-06bf0decd51c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:40.587863 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8149356a-c39b-488d-95c5-06bf0decd51c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:40.723142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8149356a-c39b-488d-95c5-06bf0decd51c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:40.731832 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8149356a-c39b-488d-95c5-06bf0decd51c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.157590 Aug 31 11:47:40.732395 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 337/675] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:40 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:41.117001 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bac6d7cc-5364-4798-81f2-64427426cd89 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:41.117615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-bac6d7cc-5364-4798-81f2-64427426cd89 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:41.124071 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bac6d7cc-5364-4798-81f2-64427426cd89 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:41.124583 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bac6d7cc-5364-4798-81f2-64427426cd89 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:41.125020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bac6d7cc-5364-4798-81f2-64427426cd89 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:41.125713 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bac6d7cc-5364-4798-81f2-64427426cd89 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:41.126165 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bac6d7cc-5364-4798-81f2-64427426cd89 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:41.126590 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bac6d7cc-5364-4798-81f2-64427426cd89 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:41.265023 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-bac6d7cc-5364-4798-81f2-64427426cd89 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:41.273484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-bac6d7cc-5364-4798-81f2-64427426cd89 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:41.274923 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-bac6d7cc-5364-4798-81f2-64427426cd89 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:41.276077 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-bac6d7cc-5364-4798-81f2-64427426cd89 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.164054 Aug 31 11:47:41.276655 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 339/676] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:41 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:41.754511 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d58fa782-228c-41d7-9106-aa0c8c3ea05d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:41.755127 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d58fa782-228c-41d7-9106-aa0c8c3ea05d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:41.761542 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d58fa782-228c-41d7-9106-aa0c8c3ea05d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:41.762024 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d58fa782-228c-41d7-9106-aa0c8c3ea05d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:41.762461 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d58fa782-228c-41d7-9106-aa0c8c3ea05d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:41.763147 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d58fa782-228c-41d7-9106-aa0c8c3ea05d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:41.763598 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d58fa782-228c-41d7-9106-aa0c8c3ea05d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:41.764024 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d58fa782-228c-41d7-9106-aa0c8c3ea05d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:41.907845 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d58fa782-228c-41d7-9106-aa0c8c3ea05d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:41.916403 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d58fa782-228c-41d7-9106-aa0c8c3ea05d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.166535 Aug 31 11:47:41.917221 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 338/677] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:41 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:47:42.298791 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-13893529-c1c0-4b2a-82a3-e0af8327ed19 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:42.299397 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-13893529-c1c0-4b2a-82a3-e0af8327ed19 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:42.307493 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13893529-c1c0-4b2a-82a3-e0af8327ed19 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:42.307978 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13893529-c1c0-4b2a-82a3-e0af8327ed19 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:42.308666 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13893529-c1c0-4b2a-82a3-e0af8327ed19 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:42.309548 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13893529-c1c0-4b2a-82a3-e0af8327ed19 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:42.310031 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13893529-c1c0-4b2a-82a3-e0af8327ed19 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:42.311090 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-13893529-c1c0-4b2a-82a3-e0af8327ed19 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:42.451431 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-13893529-c1c0-4b2a-82a3-e0af8327ed19 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:42.460644 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-13893529-c1c0-4b2a-82a3-e0af8327ed19 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:42.462078 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-13893529-c1c0-4b2a-82a3-e0af8327ed19 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:42.463288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-13893529-c1c0-4b2a-82a3-e0af8327ed19 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.168840 Aug 31 11:47:42.463843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 340/678] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:42 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:42.938452 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-406e594a-e89c-44d6-b769-bef659152d1a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:42.939784 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-406e594a-e89c-44d6-b769-bef659152d1a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:42.947682 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-406e594a-e89c-44d6-b769-bef659152d1a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:42.948533 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-406e594a-e89c-44d6-b769-bef659152d1a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:42.949186 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-406e594a-e89c-44d6-b769-bef659152d1a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:42.950118 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-406e594a-e89c-44d6-b769-bef659152d1a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:42.950672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-406e594a-e89c-44d6-b769-bef659152d1a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:42.951407 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-406e594a-e89c-44d6-b769-bef659152d1a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:43.334347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-406e594a-e89c-44d6-b769-bef659152d1a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:43.352317 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-406e594a-e89c-44d6-b769-bef659152d1a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.417432 Aug 31 11:47:43.365399 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 339/679] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:42 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:43.487295 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e099b832-b9ab-4fd4-9081-fb5aefa37f55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:43.487906 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e099b832-b9ab-4fd4-9081-fb5aefa37f55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:43.497207 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e099b832-b9ab-4fd4-9081-fb5aefa37f55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:43.498011 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e099b832-b9ab-4fd4-9081-fb5aefa37f55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:43.498793 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e099b832-b9ab-4fd4-9081-fb5aefa37f55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:43.500627 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e099b832-b9ab-4fd4-9081-fb5aefa37f55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:43.501288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e099b832-b9ab-4fd4-9081-fb5aefa37f55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:43.501899 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e099b832-b9ab-4fd4-9081-fb5aefa37f55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:43.673328 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e099b832-b9ab-4fd4-9081-fb5aefa37f55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:43.723242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e099b832-b9ab-4fd4-9081-fb5aefa37f55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:43.725061 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e099b832-b9ab-4fd4-9081-fb5aefa37f55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:43.726276 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e099b832-b9ab-4fd4-9081-fb5aefa37f55 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.243681 Aug 31 11:47:43.755783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 341/680] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:43 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:44.375411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ff55a905-4510-4949-a1e3-2365a71b10d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:44.376195 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ff55a905-4510-4949-a1e3-2365a71b10d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:44.383886 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ff55a905-4510-4949-a1e3-2365a71b10d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:44.384826 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ff55a905-4510-4949-a1e3-2365a71b10d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:44.385351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ff55a905-4510-4949-a1e3-2365a71b10d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:44.386269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ff55a905-4510-4949-a1e3-2365a71b10d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:44.386922 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ff55a905-4510-4949-a1e3-2365a71b10d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:44.387531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ff55a905-4510-4949-a1e3-2365a71b10d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:44.573781 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ff55a905-4510-4949-a1e3-2365a71b10d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:44.586706 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ff55a905-4510-4949-a1e3-2365a71b10d9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.215204 Aug 31 11:47:44.587878 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 340/681] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:44 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:44.764977 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5c460d55-e725-4ded-bc63-6d8eca848e6d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:44.765570 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5c460d55-e725-4ded-bc63-6d8eca848e6d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:44.771972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5c460d55-e725-4ded-bc63-6d8eca848e6d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:44.772736 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5c460d55-e725-4ded-bc63-6d8eca848e6d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:44.773340 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5c460d55-e725-4ded-bc63-6d8eca848e6d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:44.774189 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5c460d55-e725-4ded-bc63-6d8eca848e6d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:44.774787 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5c460d55-e725-4ded-bc63-6d8eca848e6d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:44.775365 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5c460d55-e725-4ded-bc63-6d8eca848e6d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:44.915523 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5c460d55-e725-4ded-bc63-6d8eca848e6d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:44.924001 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5c460d55-e725-4ded-bc63-6d8eca848e6d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:44.925476 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5c460d55-e725-4ded-bc63-6d8eca848e6d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:44.927475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5c460d55-e725-4ded-bc63-6d8eca848e6d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.166403 Aug 31 11:47:44.928892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 342/682] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:44 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:45.608051 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c0ab685d-f0d4-42f4-a2cb-e8e678956309 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:45.609619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c0ab685d-f0d4-42f4-a2cb-e8e678956309 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:45.616201 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c0ab685d-f0d4-42f4-a2cb-e8e678956309 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:45.616712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c0ab685d-f0d4-42f4-a2cb-e8e678956309 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:45.617397 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c0ab685d-f0d4-42f4-a2cb-e8e678956309 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:45.618320 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c0ab685d-f0d4-42f4-a2cb-e8e678956309 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:45.618953 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c0ab685d-f0d4-42f4-a2cb-e8e678956309 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:45.619571 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c0ab685d-f0d4-42f4-a2cb-e8e678956309 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:45.765023 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c0ab685d-f0d4-42f4-a2cb-e8e678956309 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:45.783496 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c0ab685d-f0d4-42f4-a2cb-e8e678956309 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.179315 Aug 31 11:47:45.797427 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 341/683] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:45 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:45.951881 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ed7fca83-8492-4cea-bc5c-3bf5b0e4393b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:45.952476 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ed7fca83-8492-4cea-bc5c-3bf5b0e4393b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:45.959768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed7fca83-8492-4cea-bc5c-3bf5b0e4393b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:45.960335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed7fca83-8492-4cea-bc5c-3bf5b0e4393b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:45.960985 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed7fca83-8492-4cea-bc5c-3bf5b0e4393b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:45.961756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed7fca83-8492-4cea-bc5c-3bf5b0e4393b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:45.962399 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed7fca83-8492-4cea-bc5c-3bf5b0e4393b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:45.966600 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed7fca83-8492-4cea-bc5c-3bf5b0e4393b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:46.154061 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ed7fca83-8492-4cea-bc5c-3bf5b0e4393b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:46.165540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ed7fca83-8492-4cea-bc5c-3bf5b0e4393b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:46.167094 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ed7fca83-8492-4cea-bc5c-3bf5b0e4393b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:46.168367 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ed7fca83-8492-4cea-bc5c-3bf5b0e4393b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.221037 Aug 31 11:47:46.169309 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 343/684] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:45 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:46.807635 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c1e35769-c282-409d-8667-baff5fe605da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:46.809180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c1e35769-c282-409d-8667-baff5fe605da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:46.817213 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1e35769-c282-409d-8667-baff5fe605da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:46.817941 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1e35769-c282-409d-8667-baff5fe605da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:46.819067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1e35769-c282-409d-8667-baff5fe605da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:46.819998 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1e35769-c282-409d-8667-baff5fe605da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:46.821005 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1e35769-c282-409d-8667-baff5fe605da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:46.821866 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1e35769-c282-409d-8667-baff5fe605da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:46.975918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c1e35769-c282-409d-8667-baff5fe605da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:46.985978 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c1e35769-c282-409d-8667-baff5fe605da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1720 microversion: 2.1 time: 0.182412 Aug 31 11:47:46.986734 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 342/685] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:46 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:47.192290 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3537c895-d9c1-4d3a-8716-b76f8ca3469d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:47.192943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3537c895-d9c1-4d3a-8716-b76f8ca3469d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:47.197097 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c326a258-edbd-4966-ad1b-4ab92361da85 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:47.197622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c326a258-edbd-4966-ad1b-4ab92361da85 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:47.206699 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3537c895-d9c1-4d3a-8716-b76f8ca3469d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:47.207416 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3537c895-d9c1-4d3a-8716-b76f8ca3469d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:47.207850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3537c895-d9c1-4d3a-8716-b76f8ca3469d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:47.208577 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3537c895-d9c1-4d3a-8716-b76f8ca3469d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:47.209029 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3537c895-d9c1-4d3a-8716-b76f8ca3469d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:47.209451 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3537c895-d9c1-4d3a-8716-b76f8ca3469d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:47.211413 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c326a258-edbd-4966-ad1b-4ab92361da85 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:47.211980 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c326a258-edbd-4966-ad1b-4ab92361da85 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:47.212511 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c326a258-edbd-4966-ad1b-4ab92361da85 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:47.213457 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c326a258-edbd-4966-ad1b-4ab92361da85 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:47.213996 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c326a258-edbd-4966-ad1b-4ab92361da85 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:47.214484 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c326a258-edbd-4966-ad1b-4ab92361da85 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:47.358775 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3537c895-d9c1-4d3a-8716-b76f8ca3469d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:47.369773 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3537c895-d9c1-4d3a-8716-b76f8ca3469d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:47.371451 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3537c895-d9c1-4d3a-8716-b76f8ca3469d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:47.372782 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3537c895-d9c1-4d3a-8716-b76f8ca3469d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.185318 Aug 31 11:47:47.373801 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 344/686] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:47 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:47.384848 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.objects.instance [None req-c326a258-edbd-4966-ad1b-4ab92361da85 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lazy-loading 'services' on Instance uuid b68ed39e-e5a3-446a-b3a1-88b2cca92714 {{(pid=127062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:47:47.523485 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c326a258-edbd-4966-ad1b-4ab92361da85 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714/os-volume_attachments/dc8b93ca-e245-4ef1-98f3-71935316a361" status: 202 len: 0 microversion: 2.1 time: 0.330153 Aug 31 11:47:47.525900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 343/687] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 31 11:47:47 2022] DELETE /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714/os-volume_attachments/dc8b93ca-e245-4ef1-98f3-71935316a361 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:47:48.009072 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-363c9cd0-71aa-48df-a4a7-dbd5d5b72029 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:48.009989 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-363c9cd0-71aa-48df-a4a7-dbd5d5b72029 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:48.016516 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-363c9cd0-71aa-48df-a4a7-dbd5d5b72029 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:48.017009 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-363c9cd0-71aa-48df-a4a7-dbd5d5b72029 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:48.017443 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-363c9cd0-71aa-48df-a4a7-dbd5d5b72029 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:48.018133 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-363c9cd0-71aa-48df-a4a7-dbd5d5b72029 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:48.018584 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-363c9cd0-71aa-48df-a4a7-dbd5d5b72029 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:48.019006 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-363c9cd0-71aa-48df-a4a7-dbd5d5b72029 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:48.154624 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-363c9cd0-71aa-48df-a4a7-dbd5d5b72029 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:48.163900 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-363c9cd0-71aa-48df-a4a7-dbd5d5b72029 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1697 microversion: 2.1 time: 0.160025 Aug 31 11:47:48.164462 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 345/688] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:48 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:48.186825 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e9d4e87a-fdb2-445f-8a16-7c5042fe542e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:47:48.193729 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e9d4e87a-fdb2-445f-8a16-7c5042fe542e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:48.194215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e9d4e87a-fdb2-445f-8a16-7c5042fe542e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:48.194648 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e9d4e87a-fdb2-445f-8a16-7c5042fe542e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:48.265687 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e9d4e87a-fdb2-445f-8a16-7c5042fe542e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Going to try to start instance {{(pid=127062) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 11:47:48.308896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e9d4e87a-fdb2-445f-8a16-7c5042fe542e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "POST /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/action" status: 202 len: 0 microversion: 2.1 time: 0.127228 Aug 31 11:47:48.310016 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 344/689] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 31 11:47:48 2022] POST /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:47:48.319108 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7b1de8e4-337b-4714-9a0d-5f2a04067ecd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:48.319713 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7b1de8e4-337b-4714-9a0d-5f2a04067ecd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:48.332698 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b1de8e4-337b-4714-9a0d-5f2a04067ecd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:48.333735 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b1de8e4-337b-4714-9a0d-5f2a04067ecd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:48.334611 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b1de8e4-337b-4714-9a0d-5f2a04067ecd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:48.336368 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b1de8e4-337b-4714-9a0d-5f2a04067ecd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:48.336904 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b1de8e4-337b-4714-9a0d-5f2a04067ecd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:48.337738 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7b1de8e4-337b-4714-9a0d-5f2a04067ecd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:48.402542 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b8a983bc-a8aa-4de0-8a9d-57f0f9ef9f3b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:48.403536 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b8a983bc-a8aa-4de0-8a9d-57f0f9ef9f3b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:48.413035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b8a983bc-a8aa-4de0-8a9d-57f0f9ef9f3b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:48.413523 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b8a983bc-a8aa-4de0-8a9d-57f0f9ef9f3b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:48.413949 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b8a983bc-a8aa-4de0-8a9d-57f0f9ef9f3b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:48.414647 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b8a983bc-a8aa-4de0-8a9d-57f0f9ef9f3b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:48.415090 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b8a983bc-a8aa-4de0-8a9d-57f0f9ef9f3b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:48.415691 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b8a983bc-a8aa-4de0-8a9d-57f0f9ef9f3b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:48.671402 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b8a983bc-a8aa-4de0-8a9d-57f0f9ef9f3b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:48.690335 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b8a983bc-a8aa-4de0-8a9d-57f0f9ef9f3b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:48.692285 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b8a983bc-a8aa-4de0-8a9d-57f0f9ef9f3b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:48.697185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b8a983bc-a8aa-4de0-8a9d-57f0f9ef9f3b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.295454 Aug 31 11:47:48.708643 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 345/690] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:48 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:47:48.750368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-497d7eb4-8e2d-4a60-910c-41cc5f013958 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:48.750868 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-497d7eb4-8e2d-4a60-910c-41cc5f013958 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:48.758236 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-497d7eb4-8e2d-4a60-910c-41cc5f013958 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:48.758725 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-497d7eb4-8e2d-4a60-910c-41cc5f013958 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:48.764344 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-497d7eb4-8e2d-4a60-910c-41cc5f013958 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:48.765126 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-497d7eb4-8e2d-4a60-910c-41cc5f013958 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:48.765564 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-497d7eb4-8e2d-4a60-910c-41cc5f013958 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:48.766036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-497d7eb4-8e2d-4a60-910c-41cc5f013958 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:48.793970 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-497d7eb4-8e2d-4a60-910c-41cc5f013958 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Going to try to terminate instance {{(pid=127062) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:47:48.834759 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:48.849126 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7b1de8e4-337b-4714-9a0d-5f2a04067ecd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:48.859463 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7b1de8e4-337b-4714-9a0d-5f2a04067ecd tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1706 microversion: 2.1 time: 0.545676 Aug 31 11:47:48.876601 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 346/691] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:48 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1706 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:48.909440 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-497d7eb4-8e2d-4a60-910c-41cc5f013958 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 204 len: 0 microversion: 2.1 time: 0.162840 Aug 31 11:47:48.914422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 346/692] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:47:48 2022] DELETE /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:47:48.921327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8c5033a0-9948-4ac5-84b3-ec1105520624 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:48.921939 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8c5033a0-9948-4ac5-84b3-ec1105520624 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:48.928470 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c5033a0-9948-4ac5-84b3-ec1105520624 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:48.929014 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c5033a0-9948-4ac5-84b3-ec1105520624 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:48.929445 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c5033a0-9948-4ac5-84b3-ec1105520624 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:48.930134 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c5033a0-9948-4ac5-84b3-ec1105520624 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:48.930587 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c5033a0-9948-4ac5-84b3-ec1105520624 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:48.931011 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c5033a0-9948-4ac5-84b3-ec1105520624 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:49.066005 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8c5033a0-9948-4ac5-84b3-ec1105520624 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:49.076000 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8c5033a0-9948-4ac5-84b3-ec1105520624 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1513 microversion: 2.1 time: 0.159880 Aug 31 11:47:49.076616 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 347/693] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:48 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:49.733710 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-21b27d8c-7048-418d-aebf-bf5cee5b1e27 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:49.734561 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-21b27d8c-7048-418d-aebf-bf5cee5b1e27 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:49.741139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21b27d8c-7048-418d-aebf-bf5cee5b1e27 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:49.741623 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21b27d8c-7048-418d-aebf-bf5cee5b1e27 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:49.742055 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21b27d8c-7048-418d-aebf-bf5cee5b1e27 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:49.742748 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21b27d8c-7048-418d-aebf-bf5cee5b1e27 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:49.743199 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21b27d8c-7048-418d-aebf-bf5cee5b1e27 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:49.743622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21b27d8c-7048-418d-aebf-bf5cee5b1e27 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:49.882418 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8aa9bf37-538d-41fb-9492-3e5aec8002cf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:49.883926 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8aa9bf37-538d-41fb-9492-3e5aec8002cf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:49.897661 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8aa9bf37-538d-41fb-9492-3e5aec8002cf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:49.898376 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8aa9bf37-538d-41fb-9492-3e5aec8002cf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:49.898521 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-21b27d8c-7048-418d-aebf-bf5cee5b1e27 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:49.899185 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8aa9bf37-538d-41fb-9492-3e5aec8002cf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:49.900100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8aa9bf37-538d-41fb-9492-3e5aec8002cf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:49.900766 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8aa9bf37-538d-41fb-9492-3e5aec8002cf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:49.901386 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8aa9bf37-538d-41fb-9492-3e5aec8002cf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:49.911024 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-21b27d8c-7048-418d-aebf-bf5cee5b1e27 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:49.912891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-21b27d8c-7048-418d-aebf-bf5cee5b1e27 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:49.914656 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-21b27d8c-7048-418d-aebf-bf5cee5b1e27 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.188140 Aug 31 11:47:49.915778 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 347/694] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:49 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:50.060866 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8aa9bf37-538d-41fb-9492-3e5aec8002cf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:50.069594 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8aa9bf37-538d-41fb-9492-3e5aec8002cf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1706 microversion: 2.1 time: 0.191271 Aug 31 11:47:50.070344 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 348/695] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:49 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1706 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:50.099171 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9e37fd0f-cfe7-4b29-8848-c185251f258b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:50.099800 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9e37fd0f-cfe7-4b29-8848-c185251f258b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:50.101762 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:50.108520 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9e37fd0f-cfe7-4b29-8848-c185251f258b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:50.109013 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9e37fd0f-cfe7-4b29-8848-c185251f258b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:50.109445 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9e37fd0f-cfe7-4b29-8848-c185251f258b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:50.110139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9e37fd0f-cfe7-4b29-8848-c185251f258b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:50.110582 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9e37fd0f-cfe7-4b29-8848-c185251f258b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:50.111003 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9e37fd0f-cfe7-4b29-8848-c185251f258b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:50.273063 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9e37fd0f-cfe7-4b29-8848-c185251f258b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:50.282109 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9e37fd0f-cfe7-4b29-8848-c185251f258b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1513 microversion: 2.1 time: 0.187415 Aug 31 11:47:50.283011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 348/696] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:50 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:50.937983 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f5220f3b-7bf4-42c1-8869-f30b30bfaf48 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:50.938568 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f5220f3b-7bf4-42c1-8869-f30b30bfaf48 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:50.945592 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f5220f3b-7bf4-42c1-8869-f30b30bfaf48 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:50.946317 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f5220f3b-7bf4-42c1-8869-f30b30bfaf48 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:50.947393 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f5220f3b-7bf4-42c1-8869-f30b30bfaf48 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:50.947616 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f5220f3b-7bf4-42c1-8869-f30b30bfaf48 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:50.948234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f5220f3b-7bf4-42c1-8869-f30b30bfaf48 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:50.948856 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f5220f3b-7bf4-42c1-8869-f30b30bfaf48 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:51.091668 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3a34cf89-3a6a-4f24-ade6-316c5900b8fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:51.092160 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f5220f3b-7bf4-42c1-8869-f30b30bfaf48 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:51.092283 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3a34cf89-3a6a-4f24-ade6-316c5900b8fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:51.100071 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3a34cf89-3a6a-4f24-ade6-316c5900b8fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:51.100608 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3a34cf89-3a6a-4f24-ade6-316c5900b8fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:51.101223 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3a34cf89-3a6a-4f24-ade6-316c5900b8fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:51.101369 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f5220f3b-7bf4-42c1-8869-f30b30bfaf48 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:51.101931 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3a34cf89-3a6a-4f24-ade6-316c5900b8fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:51.102405 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3a34cf89-3a6a-4f24-ade6-316c5900b8fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:51.102901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f5220f3b-7bf4-42c1-8869-f30b30bfaf48 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:51.103056 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3a34cf89-3a6a-4f24-ade6-316c5900b8fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:51.104063 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f5220f3b-7bf4-42c1-8869-f30b30bfaf48 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.169943 Aug 31 11:47:51.104933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 349/697] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:50 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:51.244050 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3a34cf89-3a6a-4f24-ade6-316c5900b8fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:51.261470 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3a34cf89-3a6a-4f24-ade6-316c5900b8fc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1706 microversion: 2.1 time: 0.168314 Aug 31 11:47:51.261470 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 349/698] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:51 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1706 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:47:51.303844 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ae85ac31-dfe6-4573-992a-8e0de108c796 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:51.304662 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ae85ac31-dfe6-4573-992a-8e0de108c796 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:51.312814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ae85ac31-dfe6-4573-992a-8e0de108c796 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:51.313672 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ae85ac31-dfe6-4573-992a-8e0de108c796 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:51.314394 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ae85ac31-dfe6-4573-992a-8e0de108c796 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:51.315378 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ae85ac31-dfe6-4573-992a-8e0de108c796 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:51.316858 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ae85ac31-dfe6-4573-992a-8e0de108c796 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:51.317555 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ae85ac31-dfe6-4573-992a-8e0de108c796 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:51.469639 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ae85ac31-dfe6-4573-992a-8e0de108c796 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:51.478811 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ae85ac31-dfe6-4573-992a-8e0de108c796 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1513 microversion: 2.1 time: 0.179550 Aug 31 11:47:51.479387 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 350/699] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:51 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:51.850086 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-bdc10bd7-53db-4322-ba99-31f57f734ba3 req-171bbdc2-a97b-4d0d-8bc3-5d20bf509fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68ed39e-e5a3-446a-b3a1-88b2cca92714", "name": "network-vif-deleted", "tag": "3faabfae-6033-4b82-aa6c-e9e920a8fb64"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:47:51.861684 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-bdc10bd7-53db-4322-ba99-31f57f734ba3 req-171bbdc2-a97b-4d0d-8bc3-5d20bf509fe5 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:51.862524 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-bdc10bd7-53db-4322-ba99-31f57f734ba3 req-171bbdc2-a97b-4d0d-8bc3-5d20bf509fe5 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:51.863038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-bdc10bd7-53db-4322-ba99-31f57f734ba3 req-171bbdc2-a97b-4d0d-8bc3-5d20bf509fe5 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:51.875862 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-bdc10bd7-53db-4322-ba99-31f57f734ba3 req-171bbdc2-a97b-4d0d-8bc3-5d20bf509fe5 service nova] Creating event network-vif-deleted:3faabfae-6033-4b82-aa6c-e9e920a8fb64 for instance b68ed39e-e5a3-446a-b3a1-88b2cca92714 on hv-cinder-83976 Aug 31 11:47:51.881952 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-bdc10bd7-53db-4322-ba99-31f57f734ba3 req-171bbdc2-a97b-4d0d-8bc3-5d20bf509fe5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036793 Aug 31 11:47:51.882563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 350/700] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:47:52.129817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d96f3e50-e37d-4ed4-8adf-41947c9f0690 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:52.131234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d96f3e50-e37d-4ed4-8adf-41947c9f0690 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:52.139080 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=78 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:52.141661 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d96f3e50-e37d-4ed4-8adf-41947c9f0690 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:52.142411 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d96f3e50-e37d-4ed4-8adf-41947c9f0690 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:52.143084 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d96f3e50-e37d-4ed4-8adf-41947c9f0690 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:52.147315 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d96f3e50-e37d-4ed4-8adf-41947c9f0690 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:52.157194 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d96f3e50-e37d-4ed4-8adf-41947c9f0690 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:52.161555 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d96f3e50-e37d-4ed4-8adf-41947c9f0690 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:52.279115 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-847466a6-990c-4c16-98fd-9b5f4e7d2666 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:52.280652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-847466a6-990c-4c16-98fd-9b5f4e7d2666 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:52.292053 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-847466a6-990c-4c16-98fd-9b5f4e7d2666 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:52.292774 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-847466a6-990c-4c16-98fd-9b5f4e7d2666 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:52.293125 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-847466a6-990c-4c16-98fd-9b5f4e7d2666 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:52.293926 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-847466a6-990c-4c16-98fd-9b5f4e7d2666 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:52.294440 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-847466a6-990c-4c16-98fd-9b5f4e7d2666 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:52.294929 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-847466a6-990c-4c16-98fd-9b5f4e7d2666 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:52.398000 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d96f3e50-e37d-4ed4-8adf-41947c9f0690 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:52.414376 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d96f3e50-e37d-4ed4-8adf-41947c9f0690 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:52.417500 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d96f3e50-e37d-4ed4-8adf-41947c9f0690 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:52.421163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d96f3e50-e37d-4ed4-8adf-41947c9f0690 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.296979 Aug 31 11:47:52.435274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 351/701] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:52 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:52.461646 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-847466a6-990c-4c16-98fd-9b5f4e7d2666 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:52.473772 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-847466a6-990c-4c16-98fd-9b5f4e7d2666 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1710 microversion: 2.1 time: 0.199558 Aug 31 11:47:52.474509 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 351/702] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:52 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1710 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:47:52.501833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7c416255-bddb-4a20-9bd5-6c774ec3e754 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:52.504765 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7c416255-bddb-4a20-9bd5-6c774ec3e754 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:52.509199 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7c416255-bddb-4a20-9bd5-6c774ec3e754 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:52.509711 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7c416255-bddb-4a20-9bd5-6c774ec3e754 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:52.510148 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7c416255-bddb-4a20-9bd5-6c774ec3e754 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:52.510854 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7c416255-bddb-4a20-9bd5-6c774ec3e754 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:52.511334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7c416255-bddb-4a20-9bd5-6c774ec3e754 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:52.511754 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7c416255-bddb-4a20-9bd5-6c774ec3e754 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:52.553370 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7c416255-bddb-4a20-9bd5-6c774ec3e754 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:52.556377 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7c416255-bddb-4a20-9bd5-6c774ec3e754 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:52.556377 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7c416255-bddb-4a20-9bd5-6c774ec3e754 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:52.556377 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-7c416255-bddb-4a20-9bd5-6c774ec3e754 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lazy-loading 'fault' on Instance uuid b68ed39e-e5a3-446a-b3a1-88b2cca92714 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:47:52.615780 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7c416255-bddb-4a20-9bd5-6c774ec3e754 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:52.633972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7c416255-bddb-4a20-9bd5-6c774ec3e754 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 200 len: 1309 microversion: 2.1 time: 0.137060 Aug 31 11:47:52.648273 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 352/703] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:52 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 1309 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:47:53.447947 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f90f2763-fd43-42c5-a4de-e1dcc27d4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:53.448621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f90f2763-fd43-42c5-a4de-e1dcc27d4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:53.457498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f90f2763-fd43-42c5-a4de-e1dcc27d4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:53.458367 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f90f2763-fd43-42c5-a4de-e1dcc27d4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:53.459063 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f90f2763-fd43-42c5-a4de-e1dcc27d4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:53.459839 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f90f2763-fd43-42c5-a4de-e1dcc27d4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:53.460357 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f90f2763-fd43-42c5-a4de-e1dcc27d4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:53.460894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f90f2763-fd43-42c5-a4de-e1dcc27d4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:53.637653 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f90f2763-fd43-42c5-a4de-e1dcc27d4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:53.649376 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f90f2763-fd43-42c5-a4de-e1dcc27d4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:53.651520 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f90f2763-fd43-42c5-a4de-e1dcc27d4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:53.653462 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f90f2763-fd43-42c5-a4de-e1dcc27d4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.209138 Aug 31 11:47:53.659085 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ed5221c8-aea4-4ebf-a990-29a040afd97a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:53.661068 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ed5221c8-aea4-4ebf-a990-29a040afd97a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: b68ed39e-e5a3-446a-b3a1-88b2cca92714] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:53.668759 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed5221c8-aea4-4ebf-a990-29a040afd97a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:53.669638 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 352/704] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:53 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:53.669853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed5221c8-aea4-4ebf-a990-29a040afd97a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:53.670445 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed5221c8-aea4-4ebf-a990-29a040afd97a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:53.671307 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed5221c8-aea4-4ebf-a990-29a040afd97a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:53.673328 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed5221c8-aea4-4ebf-a990-29a040afd97a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:53.676313 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ed5221c8-aea4-4ebf-a990-29a040afd97a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:53.695189 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-ed5221c8-aea4-4ebf-a990-29a040afd97a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] HTTP exception thrown: Instance b68ed39e-e5a3-446a-b3a1-88b2cca92714 could not be found. Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ed5221c8-aea4-4ebf-a990-29a040afd97a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Request method failure captured: Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 HTTP/1.1 Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0n0RQRVI4IHcPjTIxjesvfHiSaeg9tU0Maah_08SrbMLBQOWAQAaJZDxs-E7rnHDOlOn1A4xjqaeQMjGBPeeiGOQxtujtXOefTSoMkruEcNWb_dV8FGhQEN-opCK-PeXaoSkqb5IPbgyBcQVtzymgLxH978YSPNUba-JJVtWsg_Ms4 Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: f8f83820c15b492c9013ff8345668b63 Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1803310502 Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:47:53.697769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:47:53.699188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f8f83820c15b492c9013ff8345668b63", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f8f83820c15b492c9013ff8345668b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f8f83820c15b492c9013ff8345668b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f8f83820c15b492c9013ff8345668b63"}]}] Aug 31 11:47:53.699188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-VolumesSnapshotTestJSON-1803310502 Aug 31 11:47:53.699188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: f8f83820c15b492c9013ff8345668b63 Aug 31 11:47:53.699188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1803310502 Aug 31 11:47:53.699188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-VolumesSnapshotTestJSON-1803310502-project Aug 31 11:47:53.699188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:47:53.699188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:47:53.699188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 007760fc26c64cc9a9a3e6ea4325af31 Aug 31 11:47:53.699188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-VolumesSnapshotTestJSON-1803310502-project Aug 31 11:47:53.699188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:47:53.699188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance b68ed39e-e5a3-446a-b3a1-88b2cca92714 could not be found. Aug 31 11:47:53.699188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': 'b68ed39e-e5a3-446a-b3a1-88b2cca92714'} Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b68ed39e-e5a3-446a-b3a1-88b2cca92714 could not be found. Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:47:53.700036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b68ed39e-e5a3-446a-b3a1-88b2cca92714 could not be found. Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b68ed39e-e5a3-446a-b3a1-88b2cca92714 could not be found. Aug 31 11:47:53.704850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:47:53.707303 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ed5221c8-aea4-4ebf-a990-29a040afd97a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Returning 404 to user: Instance b68ed39e-e5a3-446a-b3a1-88b2cca92714 could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:47:53.707303 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ed5221c8-aea4-4ebf-a990-29a040afd97a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714" status: 404 len: 111 microversion: 2.1 time: 0.047356 Aug 31 11:47:53.707303 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 353/705] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:47:53 2022] GET /compute/v2.1/servers/b68ed39e-e5a3-446a-b3a1-88b2cca92714 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:47:54.681115 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b5bed8e6-fd05-4f01-8beb-23096d7b8a59 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:54.681560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b5bed8e6-fd05-4f01-8beb-23096d7b8a59 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:54.688156 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5bed8e6-fd05-4f01-8beb-23096d7b8a59 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:54.688680 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5bed8e6-fd05-4f01-8beb-23096d7b8a59 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:54.689119 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5bed8e6-fd05-4f01-8beb-23096d7b8a59 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:54.689849 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5bed8e6-fd05-4f01-8beb-23096d7b8a59 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:54.690294 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5bed8e6-fd05-4f01-8beb-23096d7b8a59 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:54.690716 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5bed8e6-fd05-4f01-8beb-23096d7b8a59 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:54.842410 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b5bed8e6-fd05-4f01-8beb-23096d7b8a59 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:54.851416 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b5bed8e6-fd05-4f01-8beb-23096d7b8a59 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:54.853364 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b5bed8e6-fd05-4f01-8beb-23096d7b8a59 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:54.854696 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b5bed8e6-fd05-4f01-8beb-23096d7b8a59 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.177657 Aug 31 11:47:54.855372 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 353/706] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:54 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:47:55.882174 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0185b3f8-780c-490d-80ee-cd6f70248726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:55.882803 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-0185b3f8-780c-490d-80ee-cd6f70248726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:55.889231 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0185b3f8-780c-490d-80ee-cd6f70248726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:55.889709 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0185b3f8-780c-490d-80ee-cd6f70248726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:55.890142 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0185b3f8-780c-490d-80ee-cd6f70248726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:55.890836 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0185b3f8-780c-490d-80ee-cd6f70248726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:55.891285 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0185b3f8-780c-490d-80ee-cd6f70248726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:55.891713 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0185b3f8-780c-490d-80ee-cd6f70248726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:56.142843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0185b3f8-780c-490d-80ee-cd6f70248726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:56.151295 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0185b3f8-780c-490d-80ee-cd6f70248726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:56.152778 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0185b3f8-780c-490d-80ee-cd6f70248726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:56.153939 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0185b3f8-780c-490d-80ee-cd6f70248726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.276301 Aug 31 11:47:56.154497 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 354/707] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:55 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:57.177284 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9a9a71e4-7f15-4c3e-85e0-8c7f0219d677 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:57.177887 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9a9a71e4-7f15-4c3e-85e0-8c7f0219d677 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:57.184439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9a9a71e4-7f15-4c3e-85e0-8c7f0219d677 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:57.184937 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9a9a71e4-7f15-4c3e-85e0-8c7f0219d677 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:57.185366 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9a9a71e4-7f15-4c3e-85e0-8c7f0219d677 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:57.186048 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9a9a71e4-7f15-4c3e-85e0-8c7f0219d677 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:57.186494 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9a9a71e4-7f15-4c3e-85e0-8c7f0219d677 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:57.186928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9a9a71e4-7f15-4c3e-85e0-8c7f0219d677 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:57.367647 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9a9a71e4-7f15-4c3e-85e0-8c7f0219d677 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:57.375643 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9a9a71e4-7f15-4c3e-85e0-8c7f0219d677 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:57.377117 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9a9a71e4-7f15-4c3e-85e0-8c7f0219d677 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:57.378267 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9a9a71e4-7f15-4c3e-85e0-8c7f0219d677 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.204989 Aug 31 11:47:57.378899 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 354/708] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:57 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:58.401747 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-dd5ccfbd-5c73-41a2-a54b-4d4d50193052 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:58.402379 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-dd5ccfbd-5c73-41a2-a54b-4d4d50193052 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:58.409497 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dd5ccfbd-5c73-41a2-a54b-4d4d50193052 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:58.410044 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dd5ccfbd-5c73-41a2-a54b-4d4d50193052 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:58.410482 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dd5ccfbd-5c73-41a2-a54b-4d4d50193052 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:58.411339 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dd5ccfbd-5c73-41a2-a54b-4d4d50193052 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:58.411877 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dd5ccfbd-5c73-41a2-a54b-4d4d50193052 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:58.412429 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dd5ccfbd-5c73-41a2-a54b-4d4d50193052 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:58.415593 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:47:58.550202 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-dd5ccfbd-5c73-41a2-a54b-4d4d50193052 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:58.559647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-dd5ccfbd-5c73-41a2-a54b-4d4d50193052 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:58.561463 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-dd5ccfbd-5c73-41a2-a54b-4d4d50193052 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:58.562779 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-dd5ccfbd-5c73-41a2-a54b-4d4d50193052 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1741 microversion: 2.20 time: 0.165577 Aug 31 11:47:58.563453 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 355/709] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:58 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:59.587536 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-fe84cdfc-a814-448d-afdb-055af36e742e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:47:59.588139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-fe84cdfc-a814-448d-afdb-055af36e742e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:47:59.594297 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe84cdfc-a814-448d-afdb-055af36e742e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:59.594782 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe84cdfc-a814-448d-afdb-055af36e742e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:59.595216 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe84cdfc-a814-448d-afdb-055af36e742e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:59.596160 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe84cdfc-a814-448d-afdb-055af36e742e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:59.596351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe84cdfc-a814-448d-afdb-055af36e742e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:59.596807 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe84cdfc-a814-448d-afdb-055af36e742e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:59.826942 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-fe84cdfc-a814-448d-afdb-055af36e742e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:59.835711 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-fe84cdfc-a814-448d-afdb-055af36e742e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:59.837209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-fe84cdfc-a814-448d-afdb-055af36e742e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:47:59.838593 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-fe84cdfc-a814-448d-afdb-055af36e742e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1723 microversion: 2.20 time: 0.255628 Aug 31 11:47:59.848547 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 355/710] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:47:59 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:47:59.898598 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-94d8ce78-ce84-47eb-8b56-5bcaa5d30278 req-d375ce0a-f0e7-4764-940e-a00f53932568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06215e54-27bb-4685-9a34-14109d73c81e", "name": "network-vif-unplugged", "status": "completed", "tag": "c4e2bf04-c687-4686-9210-e0be89d06923"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:47:59.909914 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-94d8ce78-ce84-47eb-8b56-5bcaa5d30278 req-d375ce0a-f0e7-4764-940e-a00f53932568 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:47:59.910650 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-94d8ce78-ce84-47eb-8b56-5bcaa5d30278 req-d375ce0a-f0e7-4764-940e-a00f53932568 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:47:59.911261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-94d8ce78-ce84-47eb-8b56-5bcaa5d30278 req-d375ce0a-f0e7-4764-940e-a00f53932568 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:47:59.922839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-94d8ce78-ce84-47eb-8b56-5bcaa5d30278 req-d375ce0a-f0e7-4764-940e-a00f53932568 service nova] Creating event network-vif-unplugged:c4e2bf04-c687-4686-9210-e0be89d06923 for instance 06215e54-27bb-4685-9a34-14109d73c81e on hv-cinder-83976 Aug 31 11:47:59.928862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-94d8ce78-ce84-47eb-8b56-5bcaa5d30278 req-d375ce0a-f0e7-4764-940e-a00f53932568 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033887 Aug 31 11:47:59.929815 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 356/711] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:48:00.862367 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5e87b7f4-c29b-4fe8-8da6-f254eeb57330 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:00.862988 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5e87b7f4-c29b-4fe8-8da6-f254eeb57330 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:00.870232 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e87b7f4-c29b-4fe8-8da6-f254eeb57330 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:00.870702 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e87b7f4-c29b-4fe8-8da6-f254eeb57330 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:00.871128 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e87b7f4-c29b-4fe8-8da6-f254eeb57330 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:00.871800 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e87b7f4-c29b-4fe8-8da6-f254eeb57330 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:00.872239 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e87b7f4-c29b-4fe8-8da6-f254eeb57330 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:00.872684 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e87b7f4-c29b-4fe8-8da6-f254eeb57330 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:01.004608 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5e87b7f4-c29b-4fe8-8da6-f254eeb57330 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:01.012605 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5e87b7f4-c29b-4fe8-8da6-f254eeb57330 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:01.014047 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5e87b7f4-c29b-4fe8-8da6-f254eeb57330 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:01.015200 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5e87b7f4-c29b-4fe8-8da6-f254eeb57330 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1723 microversion: 2.20 time: 0.156812 Aug 31 11:48:01.015763 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 356/712] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:00 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:02.039529 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-45fbbfef-3054-47b5-bc8d-2c04e58ac540 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:02.040224 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-45fbbfef-3054-47b5-bc8d-2c04e58ac540 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:02.046351 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-45fbbfef-3054-47b5-bc8d-2c04e58ac540 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:02.046832 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-45fbbfef-3054-47b5-bc8d-2c04e58ac540 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:02.047264 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-45fbbfef-3054-47b5-bc8d-2c04e58ac540 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:02.047952 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-45fbbfef-3054-47b5-bc8d-2c04e58ac540 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:02.048399 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-45fbbfef-3054-47b5-bc8d-2c04e58ac540 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:02.048851 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-45fbbfef-3054-47b5-bc8d-2c04e58ac540 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:02.181289 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-45fbbfef-3054-47b5-bc8d-2c04e58ac540 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:02.189216 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-45fbbfef-3054-47b5-bc8d-2c04e58ac540 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:02.190637 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-45fbbfef-3054-47b5-bc8d-2c04e58ac540 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:02.192629 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-45fbbfef-3054-47b5-bc8d-2c04e58ac540 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1723 microversion: 2.20 time: 0.158145 Aug 31 11:48:02.193181 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 357/713] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:02 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:03.214806 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6d6bf0f4-281d-4614-b6b3-86468ab5c456 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:03.215438 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6d6bf0f4-281d-4614-b6b3-86468ab5c456 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:03.222688 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d6bf0f4-281d-4614-b6b3-86468ab5c456 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:03.223491 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d6bf0f4-281d-4614-b6b3-86468ab5c456 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:03.223935 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d6bf0f4-281d-4614-b6b3-86468ab5c456 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:03.224662 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d6bf0f4-281d-4614-b6b3-86468ab5c456 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:03.225117 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d6bf0f4-281d-4614-b6b3-86468ab5c456 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:03.225541 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d6bf0f4-281d-4614-b6b3-86468ab5c456 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:03.355852 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6d6bf0f4-281d-4614-b6b3-86468ab5c456 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:03.364920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6d6bf0f4-281d-4614-b6b3-86468ab5c456 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:03.366366 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6d6bf0f4-281d-4614-b6b3-86468ab5c456 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:03.367514 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6d6bf0f4-281d-4614-b6b3-86468ab5c456 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1726 microversion: 2.20 time: 0.156887 Aug 31 11:48:03.368082 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 357/714] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:03 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:03.389784 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-553721be-2e16-4107-a4aa-a334c10f99c2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dac3ef0b-3279-452e-85ac-ea529a2bd6d1"}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:48:03.392097 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-553721be-2e16-4107-a4aa-a334c10f99c2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:03.398452 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-553721be-2e16-4107-a4aa-a334c10f99c2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:03.398933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-553721be-2e16-4107-a4aa-a334c10f99c2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:03.399369 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-553721be-2e16-4107-a4aa-a334c10f99c2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:03.400052 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-553721be-2e16-4107-a4aa-a334c10f99c2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:03.400522 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-553721be-2e16-4107-a4aa-a334c10f99c2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:03.400951 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-553721be-2e16-4107-a4aa-a334c10f99c2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:03.685383 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-553721be-2e16-4107-a4aa-a334c10f99c2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "POST /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299433 Aug 31 11:48:03.685999 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 358/715] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Aug 31 11:48:03 2022] POST /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:48:03.807074 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-386c8db9-dbe3-4699-a8fc-3d0a80936c31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:48:03.807668 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-386c8db9-dbe3-4699-a8fc-3d0a80936c31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:03.813831 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-386c8db9-dbe3-4699-a8fc-3d0a80936c31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:03.814287 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-386c8db9-dbe3-4699-a8fc-3d0a80936c31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:03.814721 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-386c8db9-dbe3-4699-a8fc-3d0a80936c31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:03.815411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-386c8db9-dbe3-4699-a8fc-3d0a80936c31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:03.815877 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-386c8db9-dbe3-4699-a8fc-3d0a80936c31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:03.816310 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-386c8db9-dbe3-4699-a8fc-3d0a80936c31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:03.858927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-386c8db9-dbe3-4699-a8fc-3d0a80936c31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127062) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 11:48:03.924147 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-386c8db9-dbe3-4699-a8fc-3d0a80936c31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "POST /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/action" status: 202 len: 0 microversion: 2.20 time: 0.120864 Aug 31 11:48:03.924776 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 358/716] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Aug 31 11:48:03 2022] POST /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:48:03.933013 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-88580a8a-2fd4-4e2f-9436-0a60dea370c9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:03.933617 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-88580a8a-2fd4-4e2f-9436-0a60dea370c9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:03.940125 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88580a8a-2fd4-4e2f-9436-0a60dea370c9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:03.940646 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88580a8a-2fd4-4e2f-9436-0a60dea370c9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:03.941879 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88580a8a-2fd4-4e2f-9436-0a60dea370c9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:03.942614 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88580a8a-2fd4-4e2f-9436-0a60dea370c9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:03.943059 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88580a8a-2fd4-4e2f-9436-0a60dea370c9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:03.943486 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88580a8a-2fd4-4e2f-9436-0a60dea370c9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:04.080041 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-88580a8a-2fd4-4e2f-9436-0a60dea370c9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:04.089312 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-88580a8a-2fd4-4e2f-9436-0a60dea370c9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:04.090742 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-88580a8a-2fd4-4e2f-9436-0a60dea370c9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:04.091891 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-88580a8a-2fd4-4e2f-9436-0a60dea370c9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1812 microversion: 2.20 time: 0.162737 Aug 31 11:48:04.092442 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 359/717] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:03 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1812 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:05.116601 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4413ee5d-da7d-4407-8cc4-1f1f44f48926 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:05.117219 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4413ee5d-da7d-4407-8cc4-1f1f44f48926 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:05.123281 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4413ee5d-da7d-4407-8cc4-1f1f44f48926 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:05.123758 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4413ee5d-da7d-4407-8cc4-1f1f44f48926 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:05.124190 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4413ee5d-da7d-4407-8cc4-1f1f44f48926 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:05.124901 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4413ee5d-da7d-4407-8cc4-1f1f44f48926 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:05.125352 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4413ee5d-da7d-4407-8cc4-1f1f44f48926 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:05.125776 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4413ee5d-da7d-4407-8cc4-1f1f44f48926 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:05.263947 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4413ee5d-da7d-4407-8cc4-1f1f44f48926 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:05.273175 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4413ee5d-da7d-4407-8cc4-1f1f44f48926 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:05.274620 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4413ee5d-da7d-4407-8cc4-1f1f44f48926 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:05.275780 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4413ee5d-da7d-4407-8cc4-1f1f44f48926 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1812 microversion: 2.20 time: 0.164611 Aug 31 11:48:05.276337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 359/718] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:05 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1812 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:06.298291 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d401f6ff-b56c-4e5f-9d77-850d8216dcdb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:06.299210 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d401f6ff-b56c-4e5f-9d77-850d8216dcdb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:06.306261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d401f6ff-b56c-4e5f-9d77-850d8216dcdb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:06.306734 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d401f6ff-b56c-4e5f-9d77-850d8216dcdb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:06.307165 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d401f6ff-b56c-4e5f-9d77-850d8216dcdb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:06.307847 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d401f6ff-b56c-4e5f-9d77-850d8216dcdb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:06.308294 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d401f6ff-b56c-4e5f-9d77-850d8216dcdb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:06.308763 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d401f6ff-b56c-4e5f-9d77-850d8216dcdb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:06.443998 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d401f6ff-b56c-4e5f-9d77-850d8216dcdb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:06.453392 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d401f6ff-b56c-4e5f-9d77-850d8216dcdb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:06.455029 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d401f6ff-b56c-4e5f-9d77-850d8216dcdb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:06.456867 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d401f6ff-b56c-4e5f-9d77-850d8216dcdb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1812 microversion: 2.20 time: 0.161885 Aug 31 11:48:06.457785 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 360/719] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:06 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1812 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:06.779610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-402859010", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "networks": [{"uuid": "b4ba5a0c-7e98-402d-9c47-67ed978b7684"}]}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:48:06.841622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.network.neutron [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] validate_networks() for [('b4ba5a0c-7e98-402d-9c47-67ed978b7684', None, None, None, None, None)] {{(pid=127062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:48:06.871216 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 11:48:06.871362 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Wed Aug 31 11:48:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Aug 31 11:48:07.454617 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Flavor limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:48:07.455029 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Image limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:48:07.455503 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Flavor pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:48:07.455980 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Image pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:48:07.456524 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:48:07.466251 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:07.466671 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:07.467098 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:07.467816 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:07.468264 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:07.468795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:07.479143 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-62a24d9d-841d-4513-a950-54f9249c58bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:07.479742 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-62a24d9d-841d-4513-a950-54f9249c58bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:07.486244 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62a24d9d-841d-4513-a950-54f9249c58bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:07.486508 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Getting quotas for project f8f83820c15b492c9013ff8345668b63. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:48:07.486723 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62a24d9d-841d-4513-a950-54f9249c58bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:07.487152 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62a24d9d-841d-4513-a950-54f9249c58bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:07.488429 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62a24d9d-841d-4513-a950-54f9249c58bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:07.488890 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62a24d9d-841d-4513-a950-54f9249c58bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:07.489498 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62a24d9d-841d-4513-a950-54f9249c58bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:07.491923 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Getting quotas for user 007760fc26c64cc9a9a3e6ea4325af31 and project f8f83820c15b492c9013ff8345668b63. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:48:07.504333 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Going to run 1 instances... {{(pid=127062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:48:07.506749 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:48:07.564048 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f1bcacce-280f-4a5d-ac63-454136246a0c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788463 Aug 31 11:48:07.565250 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 360/720] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:48:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:48:07.579361 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4acd5d44-0ba5-422d-83d2-3ea199a62e1c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:07.580787 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4acd5d44-0ba5-422d-83d2-3ea199a62e1c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:07.643231 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-62a24d9d-841d-4513-a950-54f9249c58bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:07.656126 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-62a24d9d-841d-4513-a950-54f9249c58bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:07.657231 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4acd5d44-0ba5-422d-83d2-3ea199a62e1c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:07.659117 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-62a24d9d-841d-4513-a950-54f9249c58bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:07.661596 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-62a24d9d-841d-4513-a950-54f9249c58bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1754 microversion: 2.20 time: 0.186311 Aug 31 11:48:07.662323 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 361/721] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:07 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:48:07.676271 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4acd5d44-0ba5-422d-83d2-3ea199a62e1c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1218 microversion: 2.1 time: 0.093364 Aug 31 11:48:07.680024 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 361/722] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:07 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:48:08.689391 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-abd9f4f0-00fc-4c7a-b7d6-a12aab543a8c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:08.689948 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-dd96df44-ff56-4835-8b03-5482ce5d40f2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:08.690327 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-dd96df44-ff56-4835-8b03-5482ce5d40f2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:08.690432 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-abd9f4f0-00fc-4c7a-b7d6-a12aab543a8c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:08.697842 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-abd9f4f0-00fc-4c7a-b7d6-a12aab543a8c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:08.698322 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-abd9f4f0-00fc-4c7a-b7d6-a12aab543a8c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:08.698751 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-abd9f4f0-00fc-4c7a-b7d6-a12aab543a8c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:08.699442 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-abd9f4f0-00fc-4c7a-b7d6-a12aab543a8c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:08.699885 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-abd9f4f0-00fc-4c7a-b7d6-a12aab543a8c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:08.700333 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-abd9f4f0-00fc-4c7a-b7d6-a12aab543a8c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:08.702138 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd96df44-ff56-4835-8b03-5482ce5d40f2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:08.702621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd96df44-ff56-4835-8b03-5482ce5d40f2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:08.705814 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd96df44-ff56-4835-8b03-5482ce5d40f2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:08.709779 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd96df44-ff56-4835-8b03-5482ce5d40f2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:08.710258 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd96df44-ff56-4835-8b03-5482ce5d40f2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:08.710901 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd96df44-ff56-4835-8b03-5482ce5d40f2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:08.765598 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-abd9f4f0-00fc-4c7a-b7d6-a12aab543a8c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:08.773962 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-abd9f4f0-00fc-4c7a-b7d6-a12aab543a8c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1270 microversion: 2.1 time: 0.088495 Aug 31 11:48:08.774531 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 362/723] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:08 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:08.907940 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-dd96df44-ff56-4835-8b03-5482ce5d40f2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:08.917414 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-dd96df44-ff56-4835-8b03-5482ce5d40f2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:08.918841 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-dd96df44-ff56-4835-8b03-5482ce5d40f2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:08.919983 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-dd96df44-ff56-4835-8b03-5482ce5d40f2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.234686 Aug 31 11:48:08.920551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 362/724] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:08 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:09.795246 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6230d763-acac-4672-a2ab-9616b515226c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:09.795914 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6230d763-acac-4672-a2ab-9616b515226c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:09.802474 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6230d763-acac-4672-a2ab-9616b515226c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:09.803037 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6230d763-acac-4672-a2ab-9616b515226c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:09.803547 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6230d763-acac-4672-a2ab-9616b515226c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:09.804333 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6230d763-acac-4672-a2ab-9616b515226c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:09.804807 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6230d763-acac-4672-a2ab-9616b515226c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:09.805230 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6230d763-acac-4672-a2ab-9616b515226c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:09.875940 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6230d763-acac-4672-a2ab-9616b515226c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:09.885513 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6230d763-acac-4672-a2ab-9616b515226c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1276 microversion: 2.1 time: 0.094247 Aug 31 11:48:09.890663 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 363/725] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:09 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:09.943653 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cc0dc5ef-e09c-48df-b1fd-a7721b9e2a31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:09.944816 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cc0dc5ef-e09c-48df-b1fd-a7721b9e2a31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:09.951468 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc0dc5ef-e09c-48df-b1fd-a7721b9e2a31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:09.951984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc0dc5ef-e09c-48df-b1fd-a7721b9e2a31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:09.952645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc0dc5ef-e09c-48df-b1fd-a7721b9e2a31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:09.953338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc0dc5ef-e09c-48df-b1fd-a7721b9e2a31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:09.953841 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc0dc5ef-e09c-48df-b1fd-a7721b9e2a31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:09.954448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc0dc5ef-e09c-48df-b1fd-a7721b9e2a31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:10.184099 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cc0dc5ef-e09c-48df-b1fd-a7721b9e2a31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:10.198043 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cc0dc5ef-e09c-48df-b1fd-a7721b9e2a31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:10.200589 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cc0dc5ef-e09c-48df-b1fd-a7721b9e2a31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:10.202267 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cc0dc5ef-e09c-48df-b1fd-a7721b9e2a31 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.263409 Aug 31 11:48:10.203642 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 363/726] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:09 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:10.907338 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4c9edd59-93b8-4f0f-8740-05055866c5e2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:10.907939 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4c9edd59-93b8-4f0f-8740-05055866c5e2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:10.915114 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c9edd59-93b8-4f0f-8740-05055866c5e2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:10.915589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c9edd59-93b8-4f0f-8740-05055866c5e2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:10.916019 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c9edd59-93b8-4f0f-8740-05055866c5e2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:10.916742 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c9edd59-93b8-4f0f-8740-05055866c5e2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:10.917196 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c9edd59-93b8-4f0f-8740-05055866c5e2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:10.917625 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c9edd59-93b8-4f0f-8740-05055866c5e2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:11.057062 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4c9edd59-93b8-4f0f-8740-05055866c5e2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:11.064771 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4c9edd59-93b8-4f0f-8740-05055866c5e2 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.161257 Aug 31 11:48:11.065328 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 364/727] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:10 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:11.226693 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-52449da7-476f-460a-8330-93f8c29f9c1a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:11.227306 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-52449da7-476f-460a-8330-93f8c29f9c1a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:11.234790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-52449da7-476f-460a-8330-93f8c29f9c1a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:11.235361 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-52449da7-476f-460a-8330-93f8c29f9c1a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:11.235791 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-52449da7-476f-460a-8330-93f8c29f9c1a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:11.236593 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-52449da7-476f-460a-8330-93f8c29f9c1a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:11.237091 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-52449da7-476f-460a-8330-93f8c29f9c1a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:11.238031 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-52449da7-476f-460a-8330-93f8c29f9c1a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:11.240902 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:48:11.380282 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-52449da7-476f-460a-8330-93f8c29f9c1a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:11.389042 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-52449da7-476f-460a-8330-93f8c29f9c1a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:11.390495 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-52449da7-476f-460a-8330-93f8c29f9c1a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:11.391862 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-52449da7-476f-460a-8330-93f8c29f9c1a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.169684 Aug 31 11:48:11.392419 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 364/728] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:11 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:12.085966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-19825eba-b739-49e6-bff7-e11060b866aa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:12.086568 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-19825eba-b739-49e6-bff7-e11060b866aa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:12.093194 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19825eba-b739-49e6-bff7-e11060b866aa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:12.093670 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19825eba-b739-49e6-bff7-e11060b866aa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:12.094094 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19825eba-b739-49e6-bff7-e11060b866aa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:12.094779 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19825eba-b739-49e6-bff7-e11060b866aa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:12.095219 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19825eba-b739-49e6-bff7-e11060b866aa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:12.095634 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19825eba-b739-49e6-bff7-e11060b866aa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:12.226257 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-19825eba-b739-49e6-bff7-e11060b866aa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:12.234127 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-19825eba-b739-49e6-bff7-e11060b866aa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.151963 Aug 31 11:48:12.234696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 365/729] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:12 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:12.416275 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6753e07a-da59-4be0-8428-274894a8eeb0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:12.416858 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6753e07a-da59-4be0-8428-274894a8eeb0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:12.423304 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6753e07a-da59-4be0-8428-274894a8eeb0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:12.423799 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6753e07a-da59-4be0-8428-274894a8eeb0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:12.424226 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6753e07a-da59-4be0-8428-274894a8eeb0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:12.424956 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6753e07a-da59-4be0-8428-274894a8eeb0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:12.426678 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6753e07a-da59-4be0-8428-274894a8eeb0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:12.427109 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6753e07a-da59-4be0-8428-274894a8eeb0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:12.560682 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6753e07a-da59-4be0-8428-274894a8eeb0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:12.569781 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6753e07a-da59-4be0-8428-274894a8eeb0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:12.571203 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6753e07a-da59-4be0-8428-274894a8eeb0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:12.572344 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6753e07a-da59-4be0-8428-274894a8eeb0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.160099 Aug 31 11:48:12.572932 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 365/730] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:12 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:13.257163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-95b69f7c-8c72-4ef9-8407-14817d841cdc tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:13.257768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-95b69f7c-8c72-4ef9-8407-14817d841cdc tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:13.264073 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-95b69f7c-8c72-4ef9-8407-14817d841cdc tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:13.264578 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-95b69f7c-8c72-4ef9-8407-14817d841cdc tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:13.265020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-95b69f7c-8c72-4ef9-8407-14817d841cdc tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:13.265700 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-95b69f7c-8c72-4ef9-8407-14817d841cdc tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:13.266146 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-95b69f7c-8c72-4ef9-8407-14817d841cdc tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:13.266567 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-95b69f7c-8c72-4ef9-8407-14817d841cdc tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:13.402281 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-95b69f7c-8c72-4ef9-8407-14817d841cdc tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:13.410461 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-95b69f7c-8c72-4ef9-8407-14817d841cdc tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.157642 Aug 31 11:48:13.411480 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 366/731] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:13 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:13.595236 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-169a3e9b-9637-4b35-8284-4daebef3bd58 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:13.595823 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-169a3e9b-9637-4b35-8284-4daebef3bd58 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:13.603139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-169a3e9b-9637-4b35-8284-4daebef3bd58 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:13.603620 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-169a3e9b-9637-4b35-8284-4daebef3bd58 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:13.604092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-169a3e9b-9637-4b35-8284-4daebef3bd58 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:13.604807 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-169a3e9b-9637-4b35-8284-4daebef3bd58 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:13.605257 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-169a3e9b-9637-4b35-8284-4daebef3bd58 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:13.605681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-169a3e9b-9637-4b35-8284-4daebef3bd58 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:13.746758 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-169a3e9b-9637-4b35-8284-4daebef3bd58 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:13.756634 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-169a3e9b-9637-4b35-8284-4daebef3bd58 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:13.758074 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-169a3e9b-9637-4b35-8284-4daebef3bd58 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:13.759224 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-169a3e9b-9637-4b35-8284-4daebef3bd58 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.167948 Aug 31 11:48:13.759785 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 366/732] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:13 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:14.432205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8a227539-8a56-4307-89a4-697efdf843fd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:14.432824 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8a227539-8a56-4307-89a4-697efdf843fd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:14.439778 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8a227539-8a56-4307-89a4-697efdf843fd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:14.440266 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8a227539-8a56-4307-89a4-697efdf843fd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:14.441337 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8a227539-8a56-4307-89a4-697efdf843fd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:14.442674 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8a227539-8a56-4307-89a4-697efdf843fd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:14.443231 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8a227539-8a56-4307-89a4-697efdf843fd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:14.443656 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8a227539-8a56-4307-89a4-697efdf843fd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:14.576416 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8a227539-8a56-4307-89a4-697efdf843fd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:14.585116 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8a227539-8a56-4307-89a4-697efdf843fd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.156734 Aug 31 11:48:14.585678 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 367/733] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:14 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:14.783151 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ee532fbd-e4f1-4daf-b5e9-759add2afead tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:14.783767 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ee532fbd-e4f1-4daf-b5e9-759add2afead tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:14.791190 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ee532fbd-e4f1-4daf-b5e9-759add2afead tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:14.791665 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ee532fbd-e4f1-4daf-b5e9-759add2afead tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:14.792097 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ee532fbd-e4f1-4daf-b5e9-759add2afead tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:14.792802 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ee532fbd-e4f1-4daf-b5e9-759add2afead tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:14.793244 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ee532fbd-e4f1-4daf-b5e9-759add2afead tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:14.793661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ee532fbd-e4f1-4daf-b5e9-759add2afead tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:14.923931 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ee532fbd-e4f1-4daf-b5e9-759add2afead tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:14.933118 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ee532fbd-e4f1-4daf-b5e9-759add2afead tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:14.934558 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ee532fbd-e4f1-4daf-b5e9-759add2afead tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:14.935723 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ee532fbd-e4f1-4daf-b5e9-759add2afead tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.156415 Aug 31 11:48:14.936542 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 367/734] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:14 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:15.605993 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e997c360-4549-4962-81bc-7ab80304133e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:15.606598 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e997c360-4549-4962-81bc-7ab80304133e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:15.613757 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e997c360-4549-4962-81bc-7ab80304133e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:15.614278 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e997c360-4549-4962-81bc-7ab80304133e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:15.614703 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e997c360-4549-4962-81bc-7ab80304133e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:15.615413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e997c360-4549-4962-81bc-7ab80304133e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:15.615830 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e997c360-4549-4962-81bc-7ab80304133e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:15.616246 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e997c360-4549-4962-81bc-7ab80304133e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:15.754041 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e997c360-4549-4962-81bc-7ab80304133e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:15.761798 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e997c360-4549-4962-81bc-7ab80304133e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.159768 Aug 31 11:48:15.762347 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 368/735] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:15 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:15.959389 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6f57c4f2-697b-4848-8263-42119cbae48f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:15.960005 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6f57c4f2-697b-4848-8263-42119cbae48f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:15.966371 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6f57c4f2-697b-4848-8263-42119cbae48f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:15.966840 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6f57c4f2-697b-4848-8263-42119cbae48f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:15.967263 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6f57c4f2-697b-4848-8263-42119cbae48f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:15.967934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6f57c4f2-697b-4848-8263-42119cbae48f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:15.968375 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6f57c4f2-697b-4848-8263-42119cbae48f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:15.968820 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6f57c4f2-697b-4848-8263-42119cbae48f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:16.108569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6f57c4f2-697b-4848-8263-42119cbae48f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:16.117684 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6f57c4f2-697b-4848-8263-42119cbae48f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:16.119121 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6f57c4f2-697b-4848-8263-42119cbae48f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:16.120294 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6f57c4f2-697b-4848-8263-42119cbae48f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.165066 Aug 31 11:48:16.121074 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 368/736] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:15 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:16.783298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fad8b81f-189e-4f00-bad7-168f2a131030 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:16.783939 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fad8b81f-189e-4f00-bad7-168f2a131030 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:16.789800 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fad8b81f-189e-4f00-bad7-168f2a131030 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:16.790267 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fad8b81f-189e-4f00-bad7-168f2a131030 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:16.790691 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fad8b81f-189e-4f00-bad7-168f2a131030 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:16.791358 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fad8b81f-189e-4f00-bad7-168f2a131030 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:16.791797 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fad8b81f-189e-4f00-bad7-168f2a131030 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:16.792210 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fad8b81f-189e-4f00-bad7-168f2a131030 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:16.929446 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-fad8b81f-189e-4f00-bad7-168f2a131030 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:16.931814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:48:16.939030 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-fad8b81f-189e-4f00-bad7-168f2a131030 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.159723 Aug 31 11:48:16.939603 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 369/737] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:16 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:17.143272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9bbf973c-07fa-4592-9af7-1af06c46a2c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:17.144921 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9bbf973c-07fa-4592-9af7-1af06c46a2c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:17.151793 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9bbf973c-07fa-4592-9af7-1af06c46a2c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:17.152285 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9bbf973c-07fa-4592-9af7-1af06c46a2c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:17.153346 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9bbf973c-07fa-4592-9af7-1af06c46a2c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:17.154052 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9bbf973c-07fa-4592-9af7-1af06c46a2c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:17.154502 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9bbf973c-07fa-4592-9af7-1af06c46a2c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:17.154956 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9bbf973c-07fa-4592-9af7-1af06c46a2c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:17.289529 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9bbf973c-07fa-4592-9af7-1af06c46a2c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:17.298229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9bbf973c-07fa-4592-9af7-1af06c46a2c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:17.299661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9bbf973c-07fa-4592-9af7-1af06c46a2c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:17.301444 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9bbf973c-07fa-4592-9af7-1af06c46a2c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.162140 Aug 31 11:48:17.302005 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 369/738] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:17 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:17.961842 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d0f5be38-5db3-4303-97a8-1e9eeeb2fc32 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:17.962456 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d0f5be38-5db3-4303-97a8-1e9eeeb2fc32 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:17.969814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0f5be38-5db3-4303-97a8-1e9eeeb2fc32 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:17.970291 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0f5be38-5db3-4303-97a8-1e9eeeb2fc32 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:17.970720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0f5be38-5db3-4303-97a8-1e9eeeb2fc32 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:17.971402 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0f5be38-5db3-4303-97a8-1e9eeeb2fc32 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:17.972515 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0f5be38-5db3-4303-97a8-1e9eeeb2fc32 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:17.972996 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0f5be38-5db3-4303-97a8-1e9eeeb2fc32 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:18.109164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d0f5be38-5db3-4303-97a8-1e9eeeb2fc32 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:18.116953 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d0f5be38-5db3-4303-97a8-1e9eeeb2fc32 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.159545 Aug 31 11:48:18.117511 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 370/739] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:17 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:18.324750 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a08fd889-f43d-4919-89e6-5e7063b38093 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:18.325362 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a08fd889-f43d-4919-89e6-5e7063b38093 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:18.327196 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:48:18.327867 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=8 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:48:18.334956 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a08fd889-f43d-4919-89e6-5e7063b38093 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:18.335437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a08fd889-f43d-4919-89e6-5e7063b38093 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:18.335873 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a08fd889-f43d-4919-89e6-5e7063b38093 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:18.336595 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a08fd889-f43d-4919-89e6-5e7063b38093 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:18.337047 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a08fd889-f43d-4919-89e6-5e7063b38093 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:18.337469 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a08fd889-f43d-4919-89e6-5e7063b38093 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:18.474807 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a08fd889-f43d-4919-89e6-5e7063b38093 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:18.483673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a08fd889-f43d-4919-89e6-5e7063b38093 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:18.485680 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a08fd889-f43d-4919-89e6-5e7063b38093 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:18.486282 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a08fd889-f43d-4919-89e6-5e7063b38093 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.165499 Aug 31 11:48:18.486843 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 370/740] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:18 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:19.137737 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-382cacc4-50e2-4377-baf9-0787f9e19bfd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:19.138415 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-382cacc4-50e2-4377-baf9-0787f9e19bfd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:19.144987 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-382cacc4-50e2-4377-baf9-0787f9e19bfd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:19.145462 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-382cacc4-50e2-4377-baf9-0787f9e19bfd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:19.145892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-382cacc4-50e2-4377-baf9-0787f9e19bfd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:19.146569 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-382cacc4-50e2-4377-baf9-0787f9e19bfd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:19.147025 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-382cacc4-50e2-4377-baf9-0787f9e19bfd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:19.147435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-382cacc4-50e2-4377-baf9-0787f9e19bfd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:19.280065 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-382cacc4-50e2-4377-baf9-0787f9e19bfd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:19.288525 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-382cacc4-50e2-4377-baf9-0787f9e19bfd tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.154501 Aug 31 11:48:19.299245 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 371/741] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:19 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:19.510445 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-72b55d85-7265-4afd-a907-31dc69a026a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:19.511068 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-72b55d85-7265-4afd-a907-31dc69a026a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:19.517555 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72b55d85-7265-4afd-a907-31dc69a026a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:19.518093 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72b55d85-7265-4afd-a907-31dc69a026a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:19.519113 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72b55d85-7265-4afd-a907-31dc69a026a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:19.519947 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72b55d85-7265-4afd-a907-31dc69a026a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:19.520437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72b55d85-7265-4afd-a907-31dc69a026a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:19.520879 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72b55d85-7265-4afd-a907-31dc69a026a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:19.656894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-72b55d85-7265-4afd-a907-31dc69a026a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:19.667633 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-72b55d85-7265-4afd-a907-31dc69a026a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:19.669116 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-72b55d85-7265-4afd-a907-31dc69a026a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:19.670286 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-72b55d85-7265-4afd-a907-31dc69a026a5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.164111 Aug 31 11:48:19.670846 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 371/742] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:19 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:20.310639 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-83b2a09d-bfb3-44ae-9f3e-608542857827 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:20.311184 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-83b2a09d-bfb3-44ae-9f3e-608542857827 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:20.319297 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-83b2a09d-bfb3-44ae-9f3e-608542857827 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:20.319783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-83b2a09d-bfb3-44ae-9f3e-608542857827 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:20.320221 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-83b2a09d-bfb3-44ae-9f3e-608542857827 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:20.320952 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-83b2a09d-bfb3-44ae-9f3e-608542857827 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:20.321408 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-83b2a09d-bfb3-44ae-9f3e-608542857827 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:20.321831 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-83b2a09d-bfb3-44ae-9f3e-608542857827 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:20.458125 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-83b2a09d-bfb3-44ae-9f3e-608542857827 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:20.466033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-83b2a09d-bfb3-44ae-9f3e-608542857827 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.159311 Aug 31 11:48:20.466607 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 372/743] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:20 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:20.694581 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7c27efcf-9f47-4ca5-8164-0989169b12fd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:20.695192 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-7c27efcf-9f47-4ca5-8164-0989169b12fd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:20.697531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:48:20.703779 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c27efcf-9f47-4ca5-8164-0989169b12fd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:20.704256 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c27efcf-9f47-4ca5-8164-0989169b12fd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:20.704717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c27efcf-9f47-4ca5-8164-0989169b12fd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:20.705404 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c27efcf-9f47-4ca5-8164-0989169b12fd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:20.705855 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c27efcf-9f47-4ca5-8164-0989169b12fd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:20.706439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7c27efcf-9f47-4ca5-8164-0989169b12fd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:20.845486 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7c27efcf-9f47-4ca5-8164-0989169b12fd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:20.854543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7c27efcf-9f47-4ca5-8164-0989169b12fd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:20.855967 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7c27efcf-9f47-4ca5-8164-0989169b12fd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:20.857136 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-7c27efcf-9f47-4ca5-8164-0989169b12fd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.167109 Aug 31 11:48:20.857697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 372/744] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:20 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:21.486506 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-67f86549-7306-421d-923a-296d7cde7696 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:21.487096 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-67f86549-7306-421d-923a-296d7cde7696 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:21.493484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-67f86549-7306-421d-923a-296d7cde7696 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:21.493953 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-67f86549-7306-421d-923a-296d7cde7696 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:21.494378 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-67f86549-7306-421d-923a-296d7cde7696 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:21.495051 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-67f86549-7306-421d-923a-296d7cde7696 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:21.495495 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-67f86549-7306-421d-923a-296d7cde7696 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:21.495910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-67f86549-7306-421d-923a-296d7cde7696 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:21.635080 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-67f86549-7306-421d-923a-296d7cde7696 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:21.642751 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-67f86549-7306-421d-923a-296d7cde7696 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.160101 Aug 31 11:48:21.643331 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 373/745] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:21 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:21.880191 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9fdde83f-6ca0-4fc0-9c61-2b175712db9a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:21.880800 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9fdde83f-6ca0-4fc0-9c61-2b175712db9a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:21.887120 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fdde83f-6ca0-4fc0-9c61-2b175712db9a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:21.887597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fdde83f-6ca0-4fc0-9c61-2b175712db9a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:21.888022 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fdde83f-6ca0-4fc0-9c61-2b175712db9a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:21.888730 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fdde83f-6ca0-4fc0-9c61-2b175712db9a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:21.889176 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fdde83f-6ca0-4fc0-9c61-2b175712db9a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:21.889595 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fdde83f-6ca0-4fc0-9c61-2b175712db9a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:22.023892 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9fdde83f-6ca0-4fc0-9c61-2b175712db9a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:22.033185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9fdde83f-6ca0-4fc0-9c61-2b175712db9a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:22.035525 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9fdde83f-6ca0-4fc0-9c61-2b175712db9a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:22.036890 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9fdde83f-6ca0-4fc0-9c61-2b175712db9a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.161174 Aug 31 11:48:22.037454 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 373/746] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:21 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:22.663316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a1171b49-ab34-4555-87eb-5e14b376e789 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:22.663947 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a1171b49-ab34-4555-87eb-5e14b376e789 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:22.666304 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=48 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:48:22.671373 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1171b49-ab34-4555-87eb-5e14b376e789 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:22.671853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1171b49-ab34-4555-87eb-5e14b376e789 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:22.672272 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1171b49-ab34-4555-87eb-5e14b376e789 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:22.672973 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1171b49-ab34-4555-87eb-5e14b376e789 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:22.673415 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1171b49-ab34-4555-87eb-5e14b376e789 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:22.673834 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1171b49-ab34-4555-87eb-5e14b376e789 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:22.807274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a1171b49-ab34-4555-87eb-5e14b376e789 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:22.814866 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a1171b49-ab34-4555-87eb-5e14b376e789 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.155597 Aug 31 11:48:22.815429 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 374/747] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:22 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:23.060312 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-eae16f3c-2610-4d26-9565-e12426bdd66e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:23.060902 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-eae16f3c-2610-4d26-9565-e12426bdd66e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:23.067790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eae16f3c-2610-4d26-9565-e12426bdd66e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:23.068306 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eae16f3c-2610-4d26-9565-e12426bdd66e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:23.068769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eae16f3c-2610-4d26-9565-e12426bdd66e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:23.069461 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eae16f3c-2610-4d26-9565-e12426bdd66e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:23.069921 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eae16f3c-2610-4d26-9565-e12426bdd66e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:23.070346 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eae16f3c-2610-4d26-9565-e12426bdd66e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:23.204561 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-eae16f3c-2610-4d26-9565-e12426bdd66e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:23.217777 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-eae16f3c-2610-4d26-9565-e12426bdd66e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:23.219386 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-eae16f3c-2610-4d26-9565-e12426bdd66e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:23.220570 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-eae16f3c-2610-4d26-9565-e12426bdd66e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.164300 Aug 31 11:48:23.221129 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 374/748] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:23 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:23.835883 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0062ce14-382f-4f5b-bf38-2bec4ee4e645 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:23.836477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-0062ce14-382f-4f5b-bf38-2bec4ee4e645 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:23.843105 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0062ce14-382f-4f5b-bf38-2bec4ee4e645 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:23.843580 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0062ce14-382f-4f5b-bf38-2bec4ee4e645 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:23.844011 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0062ce14-382f-4f5b-bf38-2bec4ee4e645 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:23.844733 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0062ce14-382f-4f5b-bf38-2bec4ee4e645 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:23.845185 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0062ce14-382f-4f5b-bf38-2bec4ee4e645 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:23.845612 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0062ce14-382f-4f5b-bf38-2bec4ee4e645 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:23.989732 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0062ce14-382f-4f5b-bf38-2bec4ee4e645 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:23.997451 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0062ce14-382f-4f5b-bf38-2bec4ee4e645 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.166154 Aug 31 11:48:23.998020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 375/749] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:23 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:24.244152 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b9830c08-b5c9-419a-a6ac-a35bb4e0e53f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:24.244751 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b9830c08-b5c9-419a-a6ac-a35bb4e0e53f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:24.252580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b9830c08-b5c9-419a-a6ac-a35bb4e0e53f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:24.253706 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b9830c08-b5c9-419a-a6ac-a35bb4e0e53f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:24.254140 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b9830c08-b5c9-419a-a6ac-a35bb4e0e53f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:24.254828 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b9830c08-b5c9-419a-a6ac-a35bb4e0e53f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:24.255277 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b9830c08-b5c9-419a-a6ac-a35bb4e0e53f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:24.255700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b9830c08-b5c9-419a-a6ac-a35bb4e0e53f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:24.388166 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b9830c08-b5c9-419a-a6ac-a35bb4e0e53f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:24.397461 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b9830c08-b5c9-419a-a6ac-a35bb4e0e53f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:24.398902 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b9830c08-b5c9-419a-a6ac-a35bb4e0e53f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:24.400046 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b9830c08-b5c9-419a-a6ac-a35bb4e0e53f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.160248 Aug 31 11:48:24.400624 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 375/750] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:24 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:25.017768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8f4e805c-ea4a-4dbd-990f-6d657459fe1e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:25.018405 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8f4e805c-ea4a-4dbd-990f-6d657459fe1e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:25.024773 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8f4e805c-ea4a-4dbd-990f-6d657459fe1e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:25.025243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8f4e805c-ea4a-4dbd-990f-6d657459fe1e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:25.025664 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8f4e805c-ea4a-4dbd-990f-6d657459fe1e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:25.026332 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8f4e805c-ea4a-4dbd-990f-6d657459fe1e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:25.026768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8f4e805c-ea4a-4dbd-990f-6d657459fe1e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:25.027182 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8f4e805c-ea4a-4dbd-990f-6d657459fe1e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:25.166833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8f4e805c-ea4a-4dbd-990f-6d657459fe1e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:25.174355 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8f4e805c-ea4a-4dbd-990f-6d657459fe1e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.160460 Aug 31 11:48:25.174966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 376/751] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:25 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:25.424809 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-45da5cb1-36f6-40c0-b8fc-12e91f642fdf tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:25.425639 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-45da5cb1-36f6-40c0-b8fc-12e91f642fdf tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:25.432007 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45da5cb1-36f6-40c0-b8fc-12e91f642fdf tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:25.432508 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45da5cb1-36f6-40c0-b8fc-12e91f642fdf tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:25.432943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45da5cb1-36f6-40c0-b8fc-12e91f642fdf tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:25.433637 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45da5cb1-36f6-40c0-b8fc-12e91f642fdf tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:25.434086 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45da5cb1-36f6-40c0-b8fc-12e91f642fdf tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:25.434507 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-45da5cb1-36f6-40c0-b8fc-12e91f642fdf tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:25.577019 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-45da5cb1-36f6-40c0-b8fc-12e91f642fdf tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:25.586164 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-45da5cb1-36f6-40c0-b8fc-12e91f642fdf tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:25.587607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-45da5cb1-36f6-40c0-b8fc-12e91f642fdf tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:25.588789 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-45da5cb1-36f6-40c0-b8fc-12e91f642fdf tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.167931 Aug 31 11:48:25.589351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 376/752] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:25 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:26.196634 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1ffbdc6e-866f-47dc-bee0-5dd11185280c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:26.197353 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1ffbdc6e-866f-47dc-bee0-5dd11185280c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:26.206916 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1ffbdc6e-866f-47dc-bee0-5dd11185280c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:26.207492 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1ffbdc6e-866f-47dc-bee0-5dd11185280c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:26.207998 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1ffbdc6e-866f-47dc-bee0-5dd11185280c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:26.208829 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1ffbdc6e-866f-47dc-bee0-5dd11185280c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:26.209339 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1ffbdc6e-866f-47dc-bee0-5dd11185280c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:26.209873 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1ffbdc6e-866f-47dc-bee0-5dd11185280c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:26.359352 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1ffbdc6e-866f-47dc-bee0-5dd11185280c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:26.369632 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1ffbdc6e-866f-47dc-bee0-5dd11185280c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.177452 Aug 31 11:48:26.370198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 377/753] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:26 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:26.615600 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-700103f6-8652-4189-b864-41be7b3e152d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:26.616614 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-700103f6-8652-4189-b864-41be7b3e152d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:26.624312 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-700103f6-8652-4189-b864-41be7b3e152d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:26.625221 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-700103f6-8652-4189-b864-41be7b3e152d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:26.625831 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-700103f6-8652-4189-b864-41be7b3e152d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:26.626551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-700103f6-8652-4189-b864-41be7b3e152d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:26.627144 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-700103f6-8652-4189-b864-41be7b3e152d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:26.628018 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-700103f6-8652-4189-b864-41be7b3e152d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:26.807763 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-700103f6-8652-4189-b864-41be7b3e152d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:26.821085 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-700103f6-8652-4189-b864-41be7b3e152d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:26.827437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-700103f6-8652-4189-b864-41be7b3e152d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:26.827437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-700103f6-8652-4189-b864-41be7b3e152d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.213719 Aug 31 11:48:26.827437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 377/754] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:26 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:27.397010 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bf1cddca-7c66-4aa0-a0a7-ecba278ab023 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:27.397615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-bf1cddca-7c66-4aa0-a0a7-ecba278ab023 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:27.404125 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bf1cddca-7c66-4aa0-a0a7-ecba278ab023 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:27.404720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bf1cddca-7c66-4aa0-a0a7-ecba278ab023 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:27.405166 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bf1cddca-7c66-4aa0-a0a7-ecba278ab023 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:27.405848 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bf1cddca-7c66-4aa0-a0a7-ecba278ab023 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:27.406297 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bf1cddca-7c66-4aa0-a0a7-ecba278ab023 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:27.406721 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bf1cddca-7c66-4aa0-a0a7-ecba278ab023 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:27.549221 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-bf1cddca-7c66-4aa0-a0a7-ecba278ab023 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:27.557250 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-bf1cddca-7c66-4aa0-a0a7-ecba278ab023 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.164710 Aug 31 11:48:27.557824 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 378/755] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:27 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:27.847311 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b4e31618-b25c-4579-bcd8-64a6d8cd562e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:27.847928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b4e31618-b25c-4579-bcd8-64a6d8cd562e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:27.854411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b4e31618-b25c-4579-bcd8-64a6d8cd562e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:27.854878 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b4e31618-b25c-4579-bcd8-64a6d8cd562e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:27.855307 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b4e31618-b25c-4579-bcd8-64a6d8cd562e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:27.855976 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b4e31618-b25c-4579-bcd8-64a6d8cd562e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:27.856416 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b4e31618-b25c-4579-bcd8-64a6d8cd562e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:27.856853 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b4e31618-b25c-4579-bcd8-64a6d8cd562e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:27.995088 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b4e31618-b25c-4579-bcd8-64a6d8cd562e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:28.005015 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b4e31618-b25c-4579-bcd8-64a6d8cd562e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:28.006487 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b4e31618-b25c-4579-bcd8-64a6d8cd562e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:28.007666 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b4e31618-b25c-4579-bcd8-64a6d8cd562e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.164357 Aug 31 11:48:28.008563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 378/756] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:27 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:28.583772 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0f0ac209-69cf-4c3c-bfcf-57da3ab9320b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:28.584356 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-0f0ac209-69cf-4c3c-bfcf-57da3ab9320b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:28.590753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0f0ac209-69cf-4c3c-bfcf-57da3ab9320b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:28.591234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0f0ac209-69cf-4c3c-bfcf-57da3ab9320b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:28.591668 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0f0ac209-69cf-4c3c-bfcf-57da3ab9320b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:28.592350 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0f0ac209-69cf-4c3c-bfcf-57da3ab9320b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:28.592833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0f0ac209-69cf-4c3c-bfcf-57da3ab9320b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:28.593258 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0f0ac209-69cf-4c3c-bfcf-57da3ab9320b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:28.723385 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0f0ac209-69cf-4c3c-bfcf-57da3ab9320b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:28.730811 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0f0ac209-69cf-4c3c-bfcf-57da3ab9320b tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.151556 Aug 31 11:48:28.731365 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 379/757] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:28 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:29.030136 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5501b4b1-921d-4c68-b6e9-38cba9620a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:29.030674 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5501b4b1-921d-4c68-b6e9-38cba9620a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:29.037608 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5501b4b1-921d-4c68-b6e9-38cba9620a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:29.038096 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5501b4b1-921d-4c68-b6e9-38cba9620a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:29.038552 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5501b4b1-921d-4c68-b6e9-38cba9620a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:29.039232 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5501b4b1-921d-4c68-b6e9-38cba9620a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:29.039683 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5501b4b1-921d-4c68-b6e9-38cba9620a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:29.040106 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5501b4b1-921d-4c68-b6e9-38cba9620a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:29.169371 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5501b4b1-921d-4c68-b6e9-38cba9620a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:29.179674 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5501b4b1-921d-4c68-b6e9-38cba9620a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:29.181125 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5501b4b1-921d-4c68-b6e9-38cba9620a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:29.182278 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5501b4b1-921d-4c68-b6e9-38cba9620a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.156090 Aug 31 11:48:29.182831 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 379/758] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:29 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:29.751998 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b4a9511b-2316-439c-817a-761f2765e4d1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:29.753159 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b4a9511b-2316-439c-817a-761f2765e4d1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:29.759758 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4a9511b-2316-439c-817a-761f2765e4d1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:29.760230 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4a9511b-2316-439c-817a-761f2765e4d1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:29.760700 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4a9511b-2316-439c-817a-761f2765e4d1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:29.761381 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4a9511b-2316-439c-817a-761f2765e4d1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:29.761827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4a9511b-2316-439c-817a-761f2765e4d1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:29.762243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b4a9511b-2316-439c-817a-761f2765e4d1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:29.892657 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b4a9511b-2316-439c-817a-761f2765e4d1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:29.900775 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b4a9511b-2316-439c-817a-761f2765e4d1 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.152603 Aug 31 11:48:29.901330 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 380/759] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:29 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:30.204206 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d7ae2907-f616-45a6-8a9a-e9406fa34de5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:30.204839 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d7ae2907-f616-45a6-8a9a-e9406fa34de5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:30.211277 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d7ae2907-f616-45a6-8a9a-e9406fa34de5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:30.211749 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d7ae2907-f616-45a6-8a9a-e9406fa34de5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:30.212174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d7ae2907-f616-45a6-8a9a-e9406fa34de5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:30.212880 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d7ae2907-f616-45a6-8a9a-e9406fa34de5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:30.213323 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d7ae2907-f616-45a6-8a9a-e9406fa34de5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:30.213738 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d7ae2907-f616-45a6-8a9a-e9406fa34de5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:30.347459 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d7ae2907-f616-45a6-8a9a-e9406fa34de5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:30.349693 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:48:30.357319 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d7ae2907-f616-45a6-8a9a-e9406fa34de5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:30.358760 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d7ae2907-f616-45a6-8a9a-e9406fa34de5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:30.359911 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d7ae2907-f616-45a6-8a9a-e9406fa34de5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.159586 Aug 31 11:48:30.360472 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 380/760] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:30 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:30.921490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2f93ecb4-891c-48b3-87fd-2d2108fc25e7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:30.922080 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2f93ecb4-891c-48b3-87fd-2d2108fc25e7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:30.928976 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f93ecb4-891c-48b3-87fd-2d2108fc25e7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:30.929449 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f93ecb4-891c-48b3-87fd-2d2108fc25e7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:30.929873 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f93ecb4-891c-48b3-87fd-2d2108fc25e7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:30.930546 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f93ecb4-891c-48b3-87fd-2d2108fc25e7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:30.931038 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f93ecb4-891c-48b3-87fd-2d2108fc25e7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:30.931402 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f93ecb4-891c-48b3-87fd-2d2108fc25e7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:31.058529 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2f93ecb4-891c-48b3-87fd-2d2108fc25e7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:31.066263 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2f93ecb4-891c-48b3-87fd-2d2108fc25e7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.148634 Aug 31 11:48:31.066825 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 381/761] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:30 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:31.383383 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-bc5efdb2-1721-47bd-810b-e114df709515 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:31.383991 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-bc5efdb2-1721-47bd-810b-e114df709515 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:31.390397 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc5efdb2-1721-47bd-810b-e114df709515 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:31.390881 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc5efdb2-1721-47bd-810b-e114df709515 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:31.391324 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc5efdb2-1721-47bd-810b-e114df709515 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:31.392015 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc5efdb2-1721-47bd-810b-e114df709515 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:31.392468 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc5efdb2-1721-47bd-810b-e114df709515 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:31.392913 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc5efdb2-1721-47bd-810b-e114df709515 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:31.525248 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-bc5efdb2-1721-47bd-810b-e114df709515 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:31.533780 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-bc5efdb2-1721-47bd-810b-e114df709515 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:31.535945 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-bc5efdb2-1721-47bd-810b-e114df709515 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:31.537125 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-bc5efdb2-1721-47bd-810b-e114df709515 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.157660 Aug 31 11:48:31.537689 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 381/762] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:31 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:32.088089 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2f6dddb5-e34f-4dc1-8a19-087db8cbac08 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:32.088735 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2f6dddb5-e34f-4dc1-8a19-087db8cbac08 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:32.095140 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f6dddb5-e34f-4dc1-8a19-087db8cbac08 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:32.095626 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f6dddb5-e34f-4dc1-8a19-087db8cbac08 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:32.096063 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f6dddb5-e34f-4dc1-8a19-087db8cbac08 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:32.097037 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f6dddb5-e34f-4dc1-8a19-087db8cbac08 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:32.097578 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f6dddb5-e34f-4dc1-8a19-087db8cbac08 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:32.098005 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2f6dddb5-e34f-4dc1-8a19-087db8cbac08 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:32.199067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-5e535cca-8f23-4460-880a-f631f744e5c2 req-197fa41e-5454-4ba7-95f0-2616c08993ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6524fd9c-0893-4dfc-83fd-86df9f38bbc5", "tag": "543e7546-e3f2-4af0-9195-4a9f481a6f4f"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:48:32.209368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-5e535cca-8f23-4460-880a-f631f744e5c2 req-197fa41e-5454-4ba7-95f0-2616c08993ba service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:32.209878 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-5e535cca-8f23-4460-880a-f631f744e5c2 req-197fa41e-5454-4ba7-95f0-2616c08993ba service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:32.210280 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-5e535cca-8f23-4460-880a-f631f744e5c2 req-197fa41e-5454-4ba7-95f0-2616c08993ba service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:32.223398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-5e535cca-8f23-4460-880a-f631f744e5c2 req-197fa41e-5454-4ba7-95f0-2616c08993ba service nova] Creating event network-changed:543e7546-e3f2-4af0-9195-4a9f481a6f4f for instance 6524fd9c-0893-4dfc-83fd-86df9f38bbc5 on hv-cinder-83976 Aug 31 11:48:32.229193 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-5e535cca-8f23-4460-880a-f631f744e5c2 req-197fa41e-5454-4ba7-95f0-2616c08993ba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033899 Aug 31 11:48:32.230168 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 382/763] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:48:32.239847 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2f6dddb5-e34f-4dc1-8a19-087db8cbac08 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:32.247732 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2f6dddb5-e34f-4dc1-8a19-087db8cbac08 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.163466 Aug 31 11:48:32.248398 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 382/764] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:32 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:32.561445 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0f693c62-d667-406a-92be-94ae4051fbab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:32.562137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0f693c62-d667-406a-92be-94ae4051fbab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:32.568795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0f693c62-d667-406a-92be-94ae4051fbab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:32.569276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0f693c62-d667-406a-92be-94ae4051fbab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:32.569707 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0f693c62-d667-406a-92be-94ae4051fbab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:32.570383 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0f693c62-d667-406a-92be-94ae4051fbab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:32.570841 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0f693c62-d667-406a-92be-94ae4051fbab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:32.571251 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0f693c62-d667-406a-92be-94ae4051fbab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:32.702967 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0f693c62-d667-406a-92be-94ae4051fbab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:32.711724 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0f693c62-d667-406a-92be-94ae4051fbab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:32.713194 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0f693c62-d667-406a-92be-94ae4051fbab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:32.714343 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0f693c62-d667-406a-92be-94ae4051fbab tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.157604 Aug 31 11:48:32.714893 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 383/765] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:32 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:33.270231 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-112c9d0a-8569-4378-a952-7224c9ce63f8 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:33.270899 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-112c9d0a-8569-4378-a952-7224c9ce63f8 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:33.277786 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-112c9d0a-8569-4378-a952-7224c9ce63f8 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:33.278267 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-112c9d0a-8569-4378-a952-7224c9ce63f8 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:33.278702 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-112c9d0a-8569-4378-a952-7224c9ce63f8 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:33.279387 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-112c9d0a-8569-4378-a952-7224c9ce63f8 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:33.279849 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-112c9d0a-8569-4378-a952-7224c9ce63f8 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:33.280271 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-112c9d0a-8569-4378-a952-7224c9ce63f8 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:33.407756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-112c9d0a-8569-4378-a952-7224c9ce63f8 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:33.415352 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-112c9d0a-8569-4378-a952-7224c9ce63f8 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.149534 Aug 31 11:48:33.415931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 383/766] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:33 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:33.738193 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d4d01644-7b89-49fa-b40b-038310d7004b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:33.738879 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d4d01644-7b89-49fa-b40b-038310d7004b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:33.745320 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d4d01644-7b89-49fa-b40b-038310d7004b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:33.745800 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d4d01644-7b89-49fa-b40b-038310d7004b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:33.746230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d4d01644-7b89-49fa-b40b-038310d7004b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:33.746915 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d4d01644-7b89-49fa-b40b-038310d7004b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:33.747358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d4d01644-7b89-49fa-b40b-038310d7004b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:33.747777 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d4d01644-7b89-49fa-b40b-038310d7004b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:33.909287 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d4d01644-7b89-49fa-b40b-038310d7004b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:33.918762 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d4d01644-7b89-49fa-b40b-038310d7004b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:33.920247 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d4d01644-7b89-49fa-b40b-038310d7004b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:33.921449 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d4d01644-7b89-49fa-b40b-038310d7004b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.187817 Aug 31 11:48:33.922022 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 384/767] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:33 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:34.435342 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-702c6987-5ab5-45d4-860b-094da8b53fa7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:34.435902 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-702c6987-5ab5-45d4-860b-094da8b53fa7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:34.442827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-702c6987-5ab5-45d4-860b-094da8b53fa7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:34.443304 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-702c6987-5ab5-45d4-860b-094da8b53fa7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:34.443729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-702c6987-5ab5-45d4-860b-094da8b53fa7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:34.444420 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-702c6987-5ab5-45d4-860b-094da8b53fa7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:34.444892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-702c6987-5ab5-45d4-860b-094da8b53fa7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:34.445313 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-702c6987-5ab5-45d4-860b-094da8b53fa7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:34.574909 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-702c6987-5ab5-45d4-860b-094da8b53fa7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:34.583112 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-702c6987-5ab5-45d4-860b-094da8b53fa7 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.151678 Aug 31 11:48:34.583669 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 384/768] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:34 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:34.945469 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3e3aef73-d65c-489e-a780-e267a7e83488 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:34.946075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3e3aef73-d65c-489e-a780-e267a7e83488 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:34.952587 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e3aef73-d65c-489e-a780-e267a7e83488 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:34.953048 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e3aef73-d65c-489e-a780-e267a7e83488 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:34.953519 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e3aef73-d65c-489e-a780-e267a7e83488 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:34.954180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e3aef73-d65c-489e-a780-e267a7e83488 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:34.954615 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e3aef73-d65c-489e-a780-e267a7e83488 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:34.955047 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e3aef73-d65c-489e-a780-e267a7e83488 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:35.083807 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3e3aef73-d65c-489e-a780-e267a7e83488 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:35.092332 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3e3aef73-d65c-489e-a780-e267a7e83488 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:35.093787 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3e3aef73-d65c-489e-a780-e267a7e83488 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:35.094934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3e3aef73-d65c-489e-a780-e267a7e83488 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.153646 Aug 31 11:48:35.095491 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 385/769] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:34 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:35.603364 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-af468c64-08ec-4d56-b217-2b0dafb3e1fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:35.603968 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-af468c64-08ec-4d56-b217-2b0dafb3e1fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:35.610407 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af468c64-08ec-4d56-b217-2b0dafb3e1fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:35.610874 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af468c64-08ec-4d56-b217-2b0dafb3e1fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:35.611299 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af468c64-08ec-4d56-b217-2b0dafb3e1fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:35.612594 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af468c64-08ec-4d56-b217-2b0dafb3e1fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:35.613272 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af468c64-08ec-4d56-b217-2b0dafb3e1fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:35.613699 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-af468c64-08ec-4d56-b217-2b0dafb3e1fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:35.743892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-af468c64-08ec-4d56-b217-2b0dafb3e1fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:35.751453 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-af468c64-08ec-4d56-b217-2b0dafb3e1fa tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.151952 Aug 31 11:48:35.752006 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 385/770] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:35 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:36.118218 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9289b876-981c-45a5-a4ae-545469c3d4ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:36.118825 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9289b876-981c-45a5-a4ae-545469c3d4ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:36.125385 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9289b876-981c-45a5-a4ae-545469c3d4ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:36.125862 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9289b876-981c-45a5-a4ae-545469c3d4ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:36.126289 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9289b876-981c-45a5-a4ae-545469c3d4ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:36.126968 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9289b876-981c-45a5-a4ae-545469c3d4ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:36.127412 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9289b876-981c-45a5-a4ae-545469c3d4ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:36.127869 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9289b876-981c-45a5-a4ae-545469c3d4ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:36.261074 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9289b876-981c-45a5-a4ae-545469c3d4ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:36.270622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9289b876-981c-45a5-a4ae-545469c3d4ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:36.272118 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9289b876-981c-45a5-a4ae-545469c3d4ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:36.273307 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9289b876-981c-45a5-a4ae-545469c3d4ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.158965 Aug 31 11:48:36.273868 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 386/771] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:36 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:36.771656 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f94d0d03-8713-4fa8-a5f7-75dceac3f260 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:36.772257 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f94d0d03-8713-4fa8-a5f7-75dceac3f260 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:36.778647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f94d0d03-8713-4fa8-a5f7-75dceac3f260 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:36.779122 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f94d0d03-8713-4fa8-a5f7-75dceac3f260 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:36.779547 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f94d0d03-8713-4fa8-a5f7-75dceac3f260 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:36.780227 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f94d0d03-8713-4fa8-a5f7-75dceac3f260 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:36.780772 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f94d0d03-8713-4fa8-a5f7-75dceac3f260 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:36.781191 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f94d0d03-8713-4fa8-a5f7-75dceac3f260 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:36.795545 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:48:36.911037 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f94d0d03-8713-4fa8-a5f7-75dceac3f260 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:36.918545 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f94d0d03-8713-4fa8-a5f7-75dceac3f260 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.150761 Aug 31 11:48:36.919100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 386/772] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:36 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:37.295534 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4dcb2614-8409-4099-a06a-a584eee2ab3d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:37.296138 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4dcb2614-8409-4099-a06a-a584eee2ab3d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:37.305095 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4dcb2614-8409-4099-a06a-a584eee2ab3d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:37.305937 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4dcb2614-8409-4099-a06a-a584eee2ab3d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:37.306605 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4dcb2614-8409-4099-a06a-a584eee2ab3d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:37.307315 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4dcb2614-8409-4099-a06a-a584eee2ab3d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:37.307771 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4dcb2614-8409-4099-a06a-a584eee2ab3d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:37.308194 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4dcb2614-8409-4099-a06a-a584eee2ab3d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:37.437069 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4dcb2614-8409-4099-a06a-a584eee2ab3d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:37.446021 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4dcb2614-8409-4099-a06a-a584eee2ab3d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:37.447459 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4dcb2614-8409-4099-a06a-a584eee2ab3d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:37.448670 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4dcb2614-8409-4099-a06a-a584eee2ab3d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.157053 Aug 31 11:48:37.449233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 387/773] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:37 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:37.939617 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0016be20-8f00-44ff-8d58-f93e7bc64539 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:37.940997 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-0016be20-8f00-44ff-8d58-f93e7bc64539 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:37.947345 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0016be20-8f00-44ff-8d58-f93e7bc64539 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:37.947817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0016be20-8f00-44ff-8d58-f93e7bc64539 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:37.948245 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0016be20-8f00-44ff-8d58-f93e7bc64539 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:37.948952 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0016be20-8f00-44ff-8d58-f93e7bc64539 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:37.949393 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0016be20-8f00-44ff-8d58-f93e7bc64539 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:37.949814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0016be20-8f00-44ff-8d58-f93e7bc64539 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:38.079600 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0016be20-8f00-44ff-8d58-f93e7bc64539 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:38.087990 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0016be20-8f00-44ff-8d58-f93e7bc64539 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.152257 Aug 31 11:48:38.088588 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 387/774] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:37 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:38.472109 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0caa6d3d-b52e-448f-b0df-f5010a185e16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:38.472680 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0caa6d3d-b52e-448f-b0df-f5010a185e16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:38.479208 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0caa6d3d-b52e-448f-b0df-f5010a185e16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:38.479716 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0caa6d3d-b52e-448f-b0df-f5010a185e16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:38.480180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0caa6d3d-b52e-448f-b0df-f5010a185e16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:38.480927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0caa6d3d-b52e-448f-b0df-f5010a185e16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:38.481380 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0caa6d3d-b52e-448f-b0df-f5010a185e16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:38.481803 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0caa6d3d-b52e-448f-b0df-f5010a185e16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:38.611732 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0caa6d3d-b52e-448f-b0df-f5010a185e16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:38.621139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0caa6d3d-b52e-448f-b0df-f5010a185e16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:38.622586 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0caa6d3d-b52e-448f-b0df-f5010a185e16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:38.623737 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0caa6d3d-b52e-448f-b0df-f5010a185e16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.155768 Aug 31 11:48:38.624302 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 388/775] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:38 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:39.108675 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-14d8b50d-4fd9-420c-9b29-bf808738c5ed tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:39.109279 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-14d8b50d-4fd9-420c-9b29-bf808738c5ed tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:39.116096 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-14d8b50d-4fd9-420c-9b29-bf808738c5ed tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:39.116606 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-14d8b50d-4fd9-420c-9b29-bf808738c5ed tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:39.117031 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-14d8b50d-4fd9-420c-9b29-bf808738c5ed tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:39.117704 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-14d8b50d-4fd9-420c-9b29-bf808738c5ed tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:39.118148 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-14d8b50d-4fd9-420c-9b29-bf808738c5ed tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:39.118564 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-14d8b50d-4fd9-420c-9b29-bf808738c5ed tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:39.247100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-14d8b50d-4fd9-420c-9b29-bf808738c5ed tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:39.256340 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-14d8b50d-4fd9-420c-9b29-bf808738c5ed tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.151515 Aug 31 11:48:39.256941 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 388/776] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:39 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:39.646775 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ef8eed02-f7c2-4b30-8db3-56a71f857daa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:39.647406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ef8eed02-f7c2-4b30-8db3-56a71f857daa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:39.653915 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ef8eed02-f7c2-4b30-8db3-56a71f857daa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:39.654385 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ef8eed02-f7c2-4b30-8db3-56a71f857daa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:39.654811 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ef8eed02-f7c2-4b30-8db3-56a71f857daa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:39.655489 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ef8eed02-f7c2-4b30-8db3-56a71f857daa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:39.655936 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ef8eed02-f7c2-4b30-8db3-56a71f857daa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:39.656355 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ef8eed02-f7c2-4b30-8db3-56a71f857daa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:39.792654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ef8eed02-f7c2-4b30-8db3-56a71f857daa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:39.801777 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ef8eed02-f7c2-4b30-8db3-56a71f857daa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:39.803217 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ef8eed02-f7c2-4b30-8db3-56a71f857daa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:39.804355 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ef8eed02-f7c2-4b30-8db3-56a71f857daa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.161962 Aug 31 11:48:39.804940 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 389/777] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:39 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:40.276895 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3522ff83-a63c-4926-adfa-2004f789fba9 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:40.277533 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3522ff83-a63c-4926-adfa-2004f789fba9 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:40.284947 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3522ff83-a63c-4926-adfa-2004f789fba9 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:40.285545 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3522ff83-a63c-4926-adfa-2004f789fba9 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:40.285980 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3522ff83-a63c-4926-adfa-2004f789fba9 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:40.286684 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3522ff83-a63c-4926-adfa-2004f789fba9 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:40.287132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3522ff83-a63c-4926-adfa-2004f789fba9 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:40.287562 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3522ff83-a63c-4926-adfa-2004f789fba9 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:40.397977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-c6b4ab3b-45f9-41b5-b8e3-776534810875 req-6c4d6b7b-6c82-484c-8b5d-01abd08e1250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6524fd9c-0893-4dfc-83fd-86df9f38bbc5", "name": "network-vif-plugged", "status": "completed", "tag": "543e7546-e3f2-4af0-9195-4a9f481a6f4f"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:48:40.407891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-c6b4ab3b-45f9-41b5-b8e3-776534810875 req-6c4d6b7b-6c82-484c-8b5d-01abd08e1250 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:40.408363 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-c6b4ab3b-45f9-41b5-b8e3-776534810875 req-6c4d6b7b-6c82-484c-8b5d-01abd08e1250 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:40.409910 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-c6b4ab3b-45f9-41b5-b8e3-776534810875 req-6c4d6b7b-6c82-484c-8b5d-01abd08e1250 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:40.422490 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-c6b4ab3b-45f9-41b5-b8e3-776534810875 req-6c4d6b7b-6c82-484c-8b5d-01abd08e1250 service nova] Creating event network-vif-plugged:543e7546-e3f2-4af0-9195-4a9f481a6f4f for instance 6524fd9c-0893-4dfc-83fd-86df9f38bbc5 on hv-cinder-83976 Aug 31 11:48:40.425428 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3522ff83-a63c-4926-adfa-2004f789fba9 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:40.428268 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-c6b4ab3b-45f9-41b5-b8e3-776534810875 req-6c4d6b7b-6c82-484c-8b5d-01abd08e1250 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035166 Aug 31 11:48:40.428899 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 390/778] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:48:40.435069 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3522ff83-a63c-4926-adfa-2004f789fba9 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.162020 Aug 31 11:48:40.436018 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 389/779] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:40 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:40.828698 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a68b82c8-de35-4012-b16c-93f2d6d27a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:40.829754 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a68b82c8-de35-4012-b16c-93f2d6d27a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:40.836333 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a68b82c8-de35-4012-b16c-93f2d6d27a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:40.836864 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a68b82c8-de35-4012-b16c-93f2d6d27a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:40.837300 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a68b82c8-de35-4012-b16c-93f2d6d27a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:40.837987 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a68b82c8-de35-4012-b16c-93f2d6d27a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:40.838437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a68b82c8-de35-4012-b16c-93f2d6d27a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:40.838858 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a68b82c8-de35-4012-b16c-93f2d6d27a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:41.013540 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a68b82c8-de35-4012-b16c-93f2d6d27a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:41.022751 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a68b82c8-de35-4012-b16c-93f2d6d27a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:41.024300 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a68b82c8-de35-4012-b16c-93f2d6d27a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:41.025604 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a68b82c8-de35-4012-b16c-93f2d6d27a34 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.201637 Aug 31 11:48:41.026270 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 391/780] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:40 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:41.459661 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ecbca861-15d6-4a27-968c-811ebbadbc7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:41.460861 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ecbca861-15d6-4a27-968c-811ebbadbc7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:41.468337 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ecbca861-15d6-4a27-968c-811ebbadbc7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:41.468851 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ecbca861-15d6-4a27-968c-811ebbadbc7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:41.469284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ecbca861-15d6-4a27-968c-811ebbadbc7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:41.469981 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ecbca861-15d6-4a27-968c-811ebbadbc7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:41.470445 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ecbca861-15d6-4a27-968c-811ebbadbc7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:41.470866 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ecbca861-15d6-4a27-968c-811ebbadbc7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:41.604289 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ecbca861-15d6-4a27-968c-811ebbadbc7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:41.611938 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ecbca861-15d6-4a27-968c-811ebbadbc7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.157845 Aug 31 11:48:41.612400 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 390/781] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:41 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:42.049168 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-089f0f58-454c-459c-8fa7-0ac799acf195 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:42.050446 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-089f0f58-454c-459c-8fa7-0ac799acf195 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:42.056772 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-089f0f58-454c-459c-8fa7-0ac799acf195 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:42.057253 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-089f0f58-454c-459c-8fa7-0ac799acf195 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:42.057678 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-089f0f58-454c-459c-8fa7-0ac799acf195 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:42.058355 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-089f0f58-454c-459c-8fa7-0ac799acf195 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:42.058796 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-089f0f58-454c-459c-8fa7-0ac799acf195 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:42.059212 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-089f0f58-454c-459c-8fa7-0ac799acf195 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:42.197796 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-089f0f58-454c-459c-8fa7-0ac799acf195 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:42.213392 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-089f0f58-454c-459c-8fa7-0ac799acf195 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:42.215551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-089f0f58-454c-459c-8fa7-0ac799acf195 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:42.217203 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-089f0f58-454c-459c-8fa7-0ac799acf195 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.171962 Aug 31 11:48:42.217761 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 392/782] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:42 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:42.459428 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-9a9fc539-30d0-45c3-bc8f-299b4856d645 req-a037b497-befe-43aa-a7f9-878e12bae96c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06215e54-27bb-4685-9a34-14109d73c81e", "name": "network-vif-plugged", "status": "completed", "tag": "c4e2bf04-c687-4686-9210-e0be89d06923"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:48:42.470839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-9a9fc539-30d0-45c3-bc8f-299b4856d645 req-a037b497-befe-43aa-a7f9-878e12bae96c service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:42.472240 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-9a9fc539-30d0-45c3-bc8f-299b4856d645 req-a037b497-befe-43aa-a7f9-878e12bae96c service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:42.472876 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-9a9fc539-30d0-45c3-bc8f-299b4856d645 req-a037b497-befe-43aa-a7f9-878e12bae96c service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:42.484061 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-9a9fc539-30d0-45c3-bc8f-299b4856d645 req-a037b497-befe-43aa-a7f9-878e12bae96c service nova] Creating event network-vif-plugged:c4e2bf04-c687-4686-9210-e0be89d06923 for instance 06215e54-27bb-4685-9a34-14109d73c81e on hv-cinder-83976 Aug 31 11:48:42.489983 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-9a9fc539-30d0-45c3-bc8f-299b4856d645 req-a037b497-befe-43aa-a7f9-878e12bae96c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034761 Aug 31 11:48:42.490570 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 391/783] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:48:42.633150 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-10f7f7fd-1e12-4b4d-a5a2-690c82b2aad3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:42.633756 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-10f7f7fd-1e12-4b4d-a5a2-690c82b2aad3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:42.639675 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-10f7f7fd-1e12-4b4d-a5a2-690c82b2aad3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:42.640156 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-10f7f7fd-1e12-4b4d-a5a2-690c82b2aad3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:42.640618 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-10f7f7fd-1e12-4b4d-a5a2-690c82b2aad3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:42.641303 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-10f7f7fd-1e12-4b4d-a5a2-690c82b2aad3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:42.641752 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-10f7f7fd-1e12-4b4d-a5a2-690c82b2aad3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:42.642174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-10f7f7fd-1e12-4b4d-a5a2-690c82b2aad3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:42.772784 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-10f7f7fd-1e12-4b4d-a5a2-690c82b2aad3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:42.780317 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-10f7f7fd-1e12-4b4d-a5a2-690c82b2aad3 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1318 microversion: 2.1 time: 0.150995 Aug 31 11:48:42.780943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 393/784] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:42 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:43.241210 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-62931583-1395-4b8b-9eea-c931e155b53d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:43.242152 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-62931583-1395-4b8b-9eea-c931e155b53d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:43.248296 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62931583-1395-4b8b-9eea-c931e155b53d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:43.248804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62931583-1395-4b8b-9eea-c931e155b53d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:43.249345 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62931583-1395-4b8b-9eea-c931e155b53d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:43.249910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62931583-1395-4b8b-9eea-c931e155b53d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:43.250396 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62931583-1395-4b8b-9eea-c931e155b53d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:43.250851 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62931583-1395-4b8b-9eea-c931e155b53d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:43.382035 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-62931583-1395-4b8b-9eea-c931e155b53d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:43.390681 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-62931583-1395-4b8b-9eea-c931e155b53d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:43.392111 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-62931583-1395-4b8b-9eea-c931e155b53d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:43.393840 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-62931583-1395-4b8b-9eea-c931e155b53d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.157040 Aug 31 11:48:43.394360 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 392/785] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:43 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:43.800713 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b2ecdd7b-2a97-42bb-b10c-2f58ea117b77 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:43.801325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b2ecdd7b-2a97-42bb-b10c-2f58ea117b77 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:43.807779 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b2ecdd7b-2a97-42bb-b10c-2f58ea117b77 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:43.808259 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b2ecdd7b-2a97-42bb-b10c-2f58ea117b77 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:43.808727 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b2ecdd7b-2a97-42bb-b10c-2f58ea117b77 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:43.809413 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b2ecdd7b-2a97-42bb-b10c-2f58ea117b77 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:43.809859 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b2ecdd7b-2a97-42bb-b10c-2f58ea117b77 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:43.810286 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b2ecdd7b-2a97-42bb-b10c-2f58ea117b77 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:43.936806 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b2ecdd7b-2a97-42bb-b10c-2f58ea117b77 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:43.945497 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b2ecdd7b-2a97-42bb-b10c-2f58ea117b77 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1506 microversion: 2.1 time: 0.148645 Aug 31 11:48:43.946076 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 394/786] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:48:43 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:48:43.967039 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4716fd2d-9797-4c9c-b680-9e5dd8d18941 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "781d075a-4f6e-4509-bff0-f2a18bf590aa", "device": "/dev/sdb"}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:48:43.970098 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4716fd2d-9797-4c9c-b680-9e5dd8d18941 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:43.976467 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4716fd2d-9797-4c9c-b680-9e5dd8d18941 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:43.976972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4716fd2d-9797-4c9c-b680-9e5dd8d18941 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:43.977401 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4716fd2d-9797-4c9c-b680-9e5dd8d18941 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:43.978084 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4716fd2d-9797-4c9c-b680-9e5dd8d18941 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:43.978527 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4716fd2d-9797-4c9c-b680-9e5dd8d18941 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:43.978946 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4716fd2d-9797-4c9c-b680-9e5dd8d18941 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:44.343654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4716fd2d-9797-4c9c-b680-9e5dd8d18941 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "POST /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380524 Aug 31 11:48:44.344325 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 393/787] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 31 11:48:43 2022] POST /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:48:44.416321 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1821eb1f-cb0a-4f57-8900-56ea9645d3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:44.416981 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1821eb1f-cb0a-4f57-8900-56ea9645d3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:44.422738 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1821eb1f-cb0a-4f57-8900-56ea9645d3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:44.423216 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1821eb1f-cb0a-4f57-8900-56ea9645d3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:44.423639 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1821eb1f-cb0a-4f57-8900-56ea9645d3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:44.424913 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1821eb1f-cb0a-4f57-8900-56ea9645d3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:44.425354 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1821eb1f-cb0a-4f57-8900-56ea9645d3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:44.425773 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1821eb1f-cb0a-4f57-8900-56ea9645d3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:44.559849 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1821eb1f-cb0a-4f57-8900-56ea9645d3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:44.569132 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1821eb1f-cb0a-4f57-8900-56ea9645d3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:44.570564 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1821eb1f-cb0a-4f57-8900-56ea9645d3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:44.571719 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1821eb1f-cb0a-4f57-8900-56ea9645d3c0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.159191 Aug 31 11:48:44.572274 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 395/788] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:44 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:45.595286 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-44a933dd-c205-4ee8-bde7-8fc11687d900 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:45.595905 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-44a933dd-c205-4ee8-bde7-8fc11687d900 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:45.602140 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-44a933dd-c205-4ee8-bde7-8fc11687d900 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:45.602614 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-44a933dd-c205-4ee8-bde7-8fc11687d900 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:45.603042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-44a933dd-c205-4ee8-bde7-8fc11687d900 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:45.603725 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-44a933dd-c205-4ee8-bde7-8fc11687d900 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:45.604171 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-44a933dd-c205-4ee8-bde7-8fc11687d900 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:45.604618 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-44a933dd-c205-4ee8-bde7-8fc11687d900 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:45.740259 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-44a933dd-c205-4ee8-bde7-8fc11687d900 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:45.749073 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-44a933dd-c205-4ee8-bde7-8fc11687d900 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:45.750572 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-44a933dd-c205-4ee8-bde7-8fc11687d900 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:45.751796 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-44a933dd-c205-4ee8-bde7-8fc11687d900 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1810 microversion: 2.20 time: 0.161228 Aug 31 11:48:45.752421 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 394/789] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:45 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:48:46.775491 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2c798180-850a-4d8e-a1f6-d0712f4612e3 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:48:46.776094 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2c798180-850a-4d8e-a1f6-d0712f4612e3 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:48:46.782470 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2c798180-850a-4d8e-a1f6-d0712f4612e3 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:46.782948 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2c798180-850a-4d8e-a1f6-d0712f4612e3 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:46.783378 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2c798180-850a-4d8e-a1f6-d0712f4612e3 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:46.784193 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2c798180-850a-4d8e-a1f6-d0712f4612e3 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:48:46.784661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2c798180-850a-4d8e-a1f6-d0712f4612e3 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:48:46.785078 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2c798180-850a-4d8e-a1f6-d0712f4612e3 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:48:46.914305 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2c798180-850a-4d8e-a1f6-d0712f4612e3 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:46.922709 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2c798180-850a-4d8e-a1f6-d0712f4612e3 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:46.924159 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2c798180-850a-4d8e-a1f6-d0712f4612e3 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:48:46.925351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2c798180-850a-4d8e-a1f6-d0712f4612e3 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1797 microversion: 2.20 time: 0.153715 Aug 31 11:48:46.925913 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 396/790] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:48:46 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1797 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:49:08.864997 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0e9244be-b9bc-418d-a39e-9878e55ea03a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:08.865524 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-0e9244be-b9bc-418d-a39e-9878e55ea03a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:08.868077 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=41 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:49:08.868750 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:49:08.874691 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0e9244be-b9bc-418d-a39e-9878e55ea03a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:08.875164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0e9244be-b9bc-418d-a39e-9878e55ea03a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:08.875591 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0e9244be-b9bc-418d-a39e-9878e55ea03a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:08.876262 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0e9244be-b9bc-418d-a39e-9878e55ea03a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:08.876779 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0e9244be-b9bc-418d-a39e-9878e55ea03a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:08.877198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0e9244be-b9bc-418d-a39e-9878e55ea03a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:09.003796 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-0e9244be-b9bc-418d-a39e-9878e55ea03a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lazy-loading 'services' on Instance uuid 6524fd9c-0893-4dfc-83fd-86df9f38bbc5 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:49:09.117421 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0e9244be-b9bc-418d-a39e-9878e55ea03a tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5/os-volume_attachments/781d075a-4f6e-4509-bff0-f2a18bf590aa" status: 202 len: 0 microversion: 2.1 time: 0.256677 Aug 31 11:49:09.118002 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 395/791] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 31 11:49:08 2022] DELETE /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5/os-volume_attachments/781d075a-4f6e-4509-bff0-f2a18bf590aa => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:49:10.233695 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ed2660de-8a39-4cf1-b4af-51f5c0c86c7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:10.234202 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ed2660de-8a39-4cf1-b4af-51f5c0c86c7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:10.237186 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=49 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:49:10.237660 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=89 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:49:10.243057 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ed2660de-8a39-4cf1-b4af-51f5c0c86c7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:10.243537 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ed2660de-8a39-4cf1-b4af-51f5c0c86c7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:10.243991 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ed2660de-8a39-4cf1-b4af-51f5c0c86c7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:10.244706 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ed2660de-8a39-4cf1-b4af-51f5c0c86c7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:10.245156 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ed2660de-8a39-4cf1-b4af-51f5c0c86c7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:10.245574 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ed2660de-8a39-4cf1-b4af-51f5c0c86c7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:10.270316 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ed2660de-8a39-4cf1-b4af-51f5c0c86c7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Going to try to terminate instance {{(pid=127062) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:49:10.348314 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ed2660de-8a39-4cf1-b4af-51f5c0c86c7e tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 204 len: 0 microversion: 2.1 time: 0.117829 Aug 31 11:49:10.349144 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 397/792] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:49:10 2022] DELETE /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:49:10.357939 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1a51afb4-c06e-4ea8-a711-cabd81214d9c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:10.358638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1a51afb4-c06e-4ea8-a711-cabd81214d9c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:10.366146 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1a51afb4-c06e-4ea8-a711-cabd81214d9c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:10.366630 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1a51afb4-c06e-4ea8-a711-cabd81214d9c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:10.367068 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1a51afb4-c06e-4ea8-a711-cabd81214d9c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:10.367754 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1a51afb4-c06e-4ea8-a711-cabd81214d9c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:10.368199 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1a51afb4-c06e-4ea8-a711-cabd81214d9c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:10.368681 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1a51afb4-c06e-4ea8-a711-cabd81214d9c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:10.499293 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1a51afb4-c06e-4ea8-a711-cabd81214d9c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:10.506931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1a51afb4-c06e-4ea8-a711-cabd81214d9c tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1512 microversion: 2.1 time: 0.153613 Aug 31 11:49:10.507491 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 396/793] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:10 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:11.529256 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-47b31c4b-c0af-49c5-9248-e38805a2bc60 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:11.529867 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-47b31c4b-c0af-49c5-9248-e38805a2bc60 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:11.536852 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-47b31c4b-c0af-49c5-9248-e38805a2bc60 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:11.537325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-47b31c4b-c0af-49c5-9248-e38805a2bc60 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:11.537754 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-47b31c4b-c0af-49c5-9248-e38805a2bc60 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:11.538436 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-47b31c4b-c0af-49c5-9248-e38805a2bc60 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:11.538883 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-47b31c4b-c0af-49c5-9248-e38805a2bc60 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:11.539305 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-47b31c4b-c0af-49c5-9248-e38805a2bc60 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:11.675070 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-47b31c4b-c0af-49c5-9248-e38805a2bc60 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:11.683064 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-47b31c4b-c0af-49c5-9248-e38805a2bc60 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1512 microversion: 2.1 time: 0.158120 Aug 31 11:49:11.683641 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 398/794] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:11 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:12.704381 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-376a1dec-b66b-4a2d-9b90-b6d89ba55710 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:12.704973 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-376a1dec-b66b-4a2d-9b90-b6d89ba55710 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:12.711565 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-376a1dec-b66b-4a2d-9b90-b6d89ba55710 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:12.712137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-376a1dec-b66b-4a2d-9b90-b6d89ba55710 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:12.712599 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-376a1dec-b66b-4a2d-9b90-b6d89ba55710 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:12.713295 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-376a1dec-b66b-4a2d-9b90-b6d89ba55710 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:12.713745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-376a1dec-b66b-4a2d-9b90-b6d89ba55710 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:12.714164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-376a1dec-b66b-4a2d-9b90-b6d89ba55710 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:12.854944 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-376a1dec-b66b-4a2d-9b90-b6d89ba55710 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007760fc26c64cc9a9a3e6ea4325af31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f83820c15b492c9013ff8345668b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:12.863703 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-376a1dec-b66b-4a2d-9b90-b6d89ba55710 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 200 len: 1512 microversion: 2.1 time: 0.163244 Aug 31 11:49:12.864284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 397/795] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:12 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:12.956669 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-00aa3279-ede7-49d3-8181-19ebcfbcf01f req-2b25c4b5-9d66-4ad4-a5ec-95f6c641833c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6524fd9c-0893-4dfc-83fd-86df9f38bbc5", "name": "network-vif-deleted", "tag": "543e7546-e3f2-4af0-9195-4a9f481a6f4f"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:49:12.966061 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-00aa3279-ede7-49d3-8181-19ebcfbcf01f req-2b25c4b5-9d66-4ad4-a5ec-95f6c641833c service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:12.966538 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-00aa3279-ede7-49d3-8181-19ebcfbcf01f req-2b25c4b5-9d66-4ad4-a5ec-95f6c641833c service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:12.966985 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-00aa3279-ede7-49d3-8181-19ebcfbcf01f req-2b25c4b5-9d66-4ad4-a5ec-95f6c641833c service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:12.980303 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-00aa3279-ede7-49d3-8181-19ebcfbcf01f req-2b25c4b5-9d66-4ad4-a5ec-95f6c641833c service nova] Creating event network-vif-deleted:543e7546-e3f2-4af0-9195-4a9f481a6f4f for instance 6524fd9c-0893-4dfc-83fd-86df9f38bbc5 on hv-cinder-83976 Aug 31 11:49:12.985596 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-00aa3279-ede7-49d3-8181-19ebcfbcf01f req-2b25c4b5-9d66-4ad4-a5ec-95f6c641833c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102932 Aug 31 11:49:12.986723 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 399/796] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:49:13.884748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d79c218a-811e-41c5-98d3-5dfebdb306d4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:13.885337 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d79c218a-811e-41c5-98d3-5dfebdb306d4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] [instance: 6524fd9c-0893-4dfc-83fd-86df9f38bbc5] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:13.891690 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d79c218a-811e-41c5-98d3-5dfebdb306d4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:13.892167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d79c218a-811e-41c5-98d3-5dfebdb306d4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:13.893189 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d79c218a-811e-41c5-98d3-5dfebdb306d4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:13.893874 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d79c218a-811e-41c5-98d3-5dfebdb306d4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:13.894324 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d79c218a-811e-41c5-98d3-5dfebdb306d4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:13.894747 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d79c218a-811e-41c5-98d3-5dfebdb306d4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:13.907745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-d79c218a-811e-41c5-98d3-5dfebdb306d4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] HTTP exception thrown: Instance 6524fd9c-0893-4dfc-83fd-86df9f38bbc5 could not be found. Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d79c218a-811e-41c5-98d3-5dfebdb306d4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Request method failure captured: Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 HTTP/1.1 Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0n0RQRVI4IHcPjTIxjesvfHiSaeg9tU0Maah_08SrbMLBQOWAQAaJZDxs-E7rnHDOlOn1A4xjqaeQMjGBPeeiGOQxtujtXOefTSoMkruEcNWb_dV8FGhQEN-opCK-PeXaoSkqb5IPbgyBcQVtzymgLxH978YSPNUba-JJVtWsg_Ms4 Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: f8f83820c15b492c9013ff8345668b63 Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1803310502 Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:49:13.909647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:49:13.911076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f8f83820c15b492c9013ff8345668b63", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f8f83820c15b492c9013ff8345668b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f8f83820c15b492c9013ff8345668b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f8f83820c15b492c9013ff8345668b63"}]}] Aug 31 11:49:13.911076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-VolumesSnapshotTestJSON-1803310502 Aug 31 11:49:13.911076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: f8f83820c15b492c9013ff8345668b63 Aug 31 11:49:13.911076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1803310502 Aug 31 11:49:13.911076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-VolumesSnapshotTestJSON-1803310502-project Aug 31 11:49:13.911076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:49:13.911076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:49:13.911076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 007760fc26c64cc9a9a3e6ea4325af31 Aug 31 11:49:13.911076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-VolumesSnapshotTestJSON-1803310502-project Aug 31 11:49:13.911076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:49:13.911076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 6524fd9c-0893-4dfc-83fd-86df9f38bbc5 could not be found. Aug 31 11:49:13.911076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '6524fd9c-0893-4dfc-83fd-86df9f38bbc5'} Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6524fd9c-0893-4dfc-83fd-86df9f38bbc5 could not be found. Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:49:13.911901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6524fd9c-0893-4dfc-83fd-86df9f38bbc5 could not be found. Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6524fd9c-0893-4dfc-83fd-86df9f38bbc5 could not be found. Aug 31 11:49:13.913761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:49:13.915272 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d79c218a-811e-41c5-98d3-5dfebdb306d4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] Returning 404 to user: Instance 6524fd9c-0893-4dfc-83fd-86df9f38bbc5 could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:49:13.915272 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d79c218a-811e-41c5-98d3-5dfebdb306d4 tempest-VolumesSnapshotTestJSON-1803310502 tempest-VolumesSnapshotTestJSON-1803310502-project] 10.222.0.60 "GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5" status: 404 len: 111 microversion: 2.1 time: 0.030163 Aug 31 11:49:13.915272 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 398/797] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:13 2022] GET /compute/v2.1/servers/6524fd9c-0893-4dfc-83fd-86df9f38bbc5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:49:38.867622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:49:38.868368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:49:38.966547 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4ef30b31-0643-4139-8649-f069ebc48a16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24674540-4608-45ff-8b48-edbb0a120d1e"}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:49:38.969030 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4ef30b31-0643-4139-8649-f069ebc48a16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:38.976275 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4ef30b31-0643-4139-8649-f069ebc48a16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:38.976786 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4ef30b31-0643-4139-8649-f069ebc48a16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:38.977221 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4ef30b31-0643-4139-8649-f069ebc48a16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:38.977910 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4ef30b31-0643-4139-8649-f069ebc48a16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:38.978366 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4ef30b31-0643-4139-8649-f069ebc48a16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:38.978791 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4ef30b31-0643-4139-8649-f069ebc48a16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:39.231407 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4ef30b31-0643-4139-8649-f069ebc48a16 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "POST /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368592 Aug 31 11:49:39.232208 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 400/798] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 31 11:49:38 2022] POST /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:49:46.273401 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6e3366e4-81ab-489d-8e42-d1ee7c374a99 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:49:46.275669 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6e3366e4-81ab-489d-8e42-d1ee7c374a99 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:46.277823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=8 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:49:46.278602 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:49:46.285108 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e3366e4-81ab-489d-8e42-d1ee7c374a99 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:46.285594 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e3366e4-81ab-489d-8e42-d1ee7c374a99 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:46.286030 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e3366e4-81ab-489d-8e42-d1ee7c374a99 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:46.286719 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e3366e4-81ab-489d-8e42-d1ee7c374a99 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:46.287167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e3366e4-81ab-489d-8e42-d1ee7c374a99 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:46.287596 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e3366e4-81ab-489d-8e42-d1ee7c374a99 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:46.362596 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6e3366e4-81ab-489d-8e42-d1ee7c374a99 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "POST /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/action" status: 202 len: 0 microversion: 2.1 time: 0.093186 Aug 31 11:49:46.363219 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 399/799] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 31 11:49:46 2022] POST /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:49:46.371844 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-450ede46-cc5b-4368-8d04-97c2530c2ccd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:46.372685 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-450ede46-cc5b-4368-8d04-97c2530c2ccd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:46.379751 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-450ede46-cc5b-4368-8d04-97c2530c2ccd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:46.380239 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-450ede46-cc5b-4368-8d04-97c2530c2ccd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:46.380741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-450ede46-cc5b-4368-8d04-97c2530c2ccd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:46.381443 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-450ede46-cc5b-4368-8d04-97c2530c2ccd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:46.381903 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-450ede46-cc5b-4368-8d04-97c2530c2ccd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:46.382337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-450ede46-cc5b-4368-8d04-97c2530c2ccd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:46.620277 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-450ede46-cc5b-4368-8d04-97c2530c2ccd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:46.629230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-450ede46-cc5b-4368-8d04-97c2530c2ccd tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1751 microversion: 2.1 time: 0.261596 Aug 31 11:49:46.629802 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 401/800] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:46 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1751 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:46.778639 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-565f8059-5342-4688-892f-7ef24f40c6c7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:49:46.780942 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-565f8059-5342-4688-892f-7ef24f40c6c7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:46.787422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-565f8059-5342-4688-892f-7ef24f40c6c7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:46.787897 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-565f8059-5342-4688-892f-7ef24f40c6c7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:46.788329 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-565f8059-5342-4688-892f-7ef24f40c6c7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:46.789041 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-565f8059-5342-4688-892f-7ef24f40c6c7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:46.789487 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-565f8059-5342-4688-892f-7ef24f40c6c7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:46.789911 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-565f8059-5342-4688-892f-7ef24f40c6c7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:46.814245 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-565f8059-5342-4688-892f-7ef24f40c6c7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lazy-loading 'flavor' on Instance uuid 7a75232d-2df1-41c7-b73d-762fba8bd8e6 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:49:46.952872 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-565f8059-5342-4688-892f-7ef24f40c6c7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "POST /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/action" status: 200 len: 32 microversion: 2.1 time: 0.178475 Aug 31 11:49:46.953704 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 400/801] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 31 11:49:46 2022] POST /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:49:46.963016 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-22d674e6-6ed0-4dcb-94e9-821789aa35ec tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:46.963657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-22d674e6-6ed0-4dcb-94e9-821789aa35ec tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:46.970819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22d674e6-6ed0-4dcb-94e9-821789aa35ec tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:46.971434 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22d674e6-6ed0-4dcb-94e9-821789aa35ec tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:46.972013 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22d674e6-6ed0-4dcb-94e9-821789aa35ec tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:46.972799 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22d674e6-6ed0-4dcb-94e9-821789aa35ec tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:46.973381 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22d674e6-6ed0-4dcb-94e9-821789aa35ec tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:46.973848 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22d674e6-6ed0-4dcb-94e9-821789aa35ec tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:47.149157 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-22d674e6-6ed0-4dcb-94e9-821789aa35ec tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:47.158154 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-22d674e6-6ed0-4dcb-94e9-821789aa35ec tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.198344 Aug 31 11:49:47.159117 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 402/802] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:46 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:49:47.652256 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ae32eb0e-6d98-4342-bda6-3fb35b109c29 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:47.653085 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ae32eb0e-6d98-4342-bda6-3fb35b109c29 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:47.659658 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ae32eb0e-6d98-4342-bda6-3fb35b109c29 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:47.660140 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ae32eb0e-6d98-4342-bda6-3fb35b109c29 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:47.660628 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ae32eb0e-6d98-4342-bda6-3fb35b109c29 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:47.661318 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ae32eb0e-6d98-4342-bda6-3fb35b109c29 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:47.661766 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ae32eb0e-6d98-4342-bda6-3fb35b109c29 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:47.662190 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ae32eb0e-6d98-4342-bda6-3fb35b109c29 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:47.809851 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ae32eb0e-6d98-4342-bda6-3fb35b109c29 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:47.820007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ae32eb0e-6d98-4342-bda6-3fb35b109c29 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1756 microversion: 2.1 time: 0.172521 Aug 31 11:49:47.820787 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 401/803] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:47 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:48.179618 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-87847fc0-0b6a-4b1b-a7ff-8dce204c47b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:48.180227 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-87847fc0-0b6a-4b1b-a7ff-8dce204c47b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:48.186614 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87847fc0-0b6a-4b1b-a7ff-8dce204c47b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:48.187100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87847fc0-0b6a-4b1b-a7ff-8dce204c47b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:48.187551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87847fc0-0b6a-4b1b-a7ff-8dce204c47b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:48.188218 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87847fc0-0b6a-4b1b-a7ff-8dce204c47b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:48.189360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87847fc0-0b6a-4b1b-a7ff-8dce204c47b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:48.189788 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87847fc0-0b6a-4b1b-a7ff-8dce204c47b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:48.320516 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-87847fc0-0b6a-4b1b-a7ff-8dce204c47b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:48.328669 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-87847fc0-0b6a-4b1b-a7ff-8dce204c47b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.152910 Aug 31 11:49:48.329377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 403/804] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:48 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:48.842413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e5f04a33-3643-4856-ae01-a7bee717eb5f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:48.843010 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e5f04a33-3643-4856-ae01-a7bee717eb5f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:48.846912 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 11:49:48.847106 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Wed Aug 31 11:49:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 (ip 10.222.0.60) !!! Aug 31 11:49:48.855803 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e5f04a33-3643-4856-ae01-a7bee717eb5f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:48.856275 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e5f04a33-3643-4856-ae01-a7bee717eb5f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:48.856743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e5f04a33-3643-4856-ae01-a7bee717eb5f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:48.857429 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e5f04a33-3643-4856-ae01-a7bee717eb5f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:48.857870 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e5f04a33-3643-4856-ae01-a7bee717eb5f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:48.858282 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e5f04a33-3643-4856-ae01-a7bee717eb5f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:49.002127 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e5f04a33-3643-4856-ae01-a7bee717eb5f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:49.010327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e5f04a33-3643-4856-ae01-a7bee717eb5f tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1756 microversion: 2.1 time: 0.171834 Aug 31 11:49:49.010893 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 402/805] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:48 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:49.350116 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-fe7e4f5a-2c7c-4e01-8a12-1cb85936e96f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:49.350717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-fe7e4f5a-2c7c-4e01-8a12-1cb85936e96f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:49.357480 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe7e4f5a-2c7c-4e01-8a12-1cb85936e96f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:49.357951 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe7e4f5a-2c7c-4e01-8a12-1cb85936e96f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:49.358374 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe7e4f5a-2c7c-4e01-8a12-1cb85936e96f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:49.359047 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe7e4f5a-2c7c-4e01-8a12-1cb85936e96f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:49.359551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe7e4f5a-2c7c-4e01-8a12-1cb85936e96f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:49.359972 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe7e4f5a-2c7c-4e01-8a12-1cb85936e96f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:49.488297 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-fe7e4f5a-2c7c-4e01-8a12-1cb85936e96f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:49.496353 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-fe7e4f5a-2c7c-4e01-8a12-1cb85936e96f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.150100 Aug 31 11:49:49.497039 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 404/806] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:49 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:49:50.033337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7d5487da-5993-4117-980a-0585a4ec4749 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:50.033977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-7d5487da-5993-4117-980a-0585a4ec4749 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:50.039813 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d5487da-5993-4117-980a-0585a4ec4749 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:50.040296 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d5487da-5993-4117-980a-0585a4ec4749 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:50.040773 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d5487da-5993-4117-980a-0585a4ec4749 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:50.041475 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d5487da-5993-4117-980a-0585a4ec4749 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:50.041926 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d5487da-5993-4117-980a-0585a4ec4749 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:50.042351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7d5487da-5993-4117-980a-0585a4ec4749 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:50.046825 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b779277b-868d-4abb-a5e3-af15e6b04c67 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:50.047326 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b779277b-868d-4abb-a5e3-af15e6b04c67 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:50.053137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b779277b-868d-4abb-a5e3-af15e6b04c67 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:50.053615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b779277b-868d-4abb-a5e3-af15e6b04c67 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:50.054038 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b779277b-868d-4abb-a5e3-af15e6b04c67 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:50.054712 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b779277b-868d-4abb-a5e3-af15e6b04c67 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:50.055292 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b779277b-868d-4abb-a5e3-af15e6b04c67 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:50.055714 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b779277b-868d-4abb-a5e3-af15e6b04c67 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:50.142467 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-b779277b-868d-4abb-a5e3-af15e6b04c67 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lazy-loading 'services' on Instance uuid c0cfd5ee-9585-4f45-b34a-b0e87ae35723 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:49:50.197354 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7d5487da-5993-4117-980a-0585a4ec4749 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:50.206358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-7d5487da-5993-4117-980a-0585a4ec4749 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1756 microversion: 2.1 time: 0.177031 Aug 31 11:49:50.206674 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 405/807] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:50 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:49:50.217413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b779277b-868d-4abb-a5e3-af15e6b04c67 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/os-volume_attachments/ae6f6c8c-f7b1-4e70-9f82-b7b9a210d842" status: 202 len: 0 microversion: 2.1 time: 0.395061 Aug 31 11:49:50.218065 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 403/808] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 31 11:49:49 2022] DELETE /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/os-volume_attachments/ae6f6c8c-f7b1-4e70-9f82-b7b9a210d842 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:49:50.518278 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-eb38f48f-176b-4b8d-b61b-bd9d3ec22273 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:50.518805 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-eb38f48f-176b-4b8d-b61b-bd9d3ec22273 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:50.525181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eb38f48f-176b-4b8d-b61b-bd9d3ec22273 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:50.525654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eb38f48f-176b-4b8d-b61b-bd9d3ec22273 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:50.526097 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eb38f48f-176b-4b8d-b61b-bd9d3ec22273 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:50.526759 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eb38f48f-176b-4b8d-b61b-bd9d3ec22273 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:50.527200 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eb38f48f-176b-4b8d-b61b-bd9d3ec22273 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:50.527613 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-eb38f48f-176b-4b8d-b61b-bd9d3ec22273 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:50.658109 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-eb38f48f-176b-4b8d-b61b-bd9d3ec22273 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:50.666191 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-eb38f48f-176b-4b8d-b61b-bd9d3ec22273 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.151986 Aug 31 11:49:50.666758 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 406/809] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:50 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:51.229175 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8fa01e8d-9520-4d75-b0c9-ef4a38514f37 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:51.229786 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8fa01e8d-9520-4d75-b0c9-ef4a38514f37 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:51.235953 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8fa01e8d-9520-4d75-b0c9-ef4a38514f37 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:51.236423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8fa01e8d-9520-4d75-b0c9-ef4a38514f37 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:51.236902 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8fa01e8d-9520-4d75-b0c9-ef4a38514f37 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:51.237580 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8fa01e8d-9520-4d75-b0c9-ef4a38514f37 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:51.238023 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8fa01e8d-9520-4d75-b0c9-ef4a38514f37 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:51.238443 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8fa01e8d-9520-4d75-b0c9-ef4a38514f37 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:51.346284 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b553581f-1c45-4181-a076-34c5053921ca tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:49:51.352211 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b553581f-1c45-4181-a076-34c5053921ca tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:51.352727 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b553581f-1c45-4181-a076-34c5053921ca tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:51.353161 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b553581f-1c45-4181-a076-34c5053921ca tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:51.375290 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b553581f-1c45-4181-a076-34c5053921ca tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Going to try to stop instance {{(pid=127062) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 11:49:51.386777 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8fa01e8d-9520-4d75-b0c9-ef4a38514f37 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:51.395448 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8fa01e8d-9520-4d75-b0c9-ef4a38514f37 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1756 microversion: 2.1 time: 0.171301 Aug 31 11:49:51.396018 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 404/810] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:51 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:51.420321 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b553581f-1c45-4181-a076-34c5053921ca tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "POST /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/action" status: 202 len: 0 microversion: 2.1 time: 0.077836 Aug 31 11:49:51.420961 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 407/811] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 31 11:49:51 2022] POST /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:49:51.428916 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-cf3382a7-4472-4932-8347-37200bccb50a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:51.429516 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-cf3382a7-4472-4932-8347-37200bccb50a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:51.435588 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cf3382a7-4472-4932-8347-37200bccb50a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:51.435991 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cf3382a7-4472-4932-8347-37200bccb50a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:51.436415 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cf3382a7-4472-4932-8347-37200bccb50a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:51.437137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cf3382a7-4472-4932-8347-37200bccb50a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:51.437649 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cf3382a7-4472-4932-8347-37200bccb50a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:51.438082 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cf3382a7-4472-4932-8347-37200bccb50a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:51.569230 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-cf3382a7-4472-4932-8347-37200bccb50a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:51.576776 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-cf3382a7-4472-4932-8347-37200bccb50a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1674 microversion: 2.1 time: 0.151570 Aug 31 11:49:51.577332 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 405/812] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:51 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:51.688072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ccd905a4-e8bc-46a2-b249-87d2ea721dce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:51.689466 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ccd905a4-e8bc-46a2-b249-87d2ea721dce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:51.695847 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ccd905a4-e8bc-46a2-b249-87d2ea721dce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:51.696323 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ccd905a4-e8bc-46a2-b249-87d2ea721dce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:51.696776 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ccd905a4-e8bc-46a2-b249-87d2ea721dce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:51.697453 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ccd905a4-e8bc-46a2-b249-87d2ea721dce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:51.697898 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ccd905a4-e8bc-46a2-b249-87d2ea721dce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:51.698315 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ccd905a4-e8bc-46a2-b249-87d2ea721dce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:51.827145 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ccd905a4-e8bc-46a2-b249-87d2ea721dce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:51.835379 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ccd905a4-e8bc-46a2-b249-87d2ea721dce tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.151977 Aug 31 11:49:51.835957 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 408/813] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:51 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:52.417149 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-08f8ac72-e678-4cb4-9bc8-8f39b109bad5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:52.417755 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-08f8ac72-e678-4cb4-9bc8-8f39b109bad5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:52.424580 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-08f8ac72-e678-4cb4-9bc8-8f39b109bad5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:52.425094 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-08f8ac72-e678-4cb4-9bc8-8f39b109bad5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:52.425525 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-08f8ac72-e678-4cb4-9bc8-8f39b109bad5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:52.426254 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-08f8ac72-e678-4cb4-9bc8-8f39b109bad5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:52.426697 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-08f8ac72-e678-4cb4-9bc8-8f39b109bad5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:52.427117 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-08f8ac72-e678-4cb4-9bc8-8f39b109bad5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:52.567003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-08f8ac72-e678-4cb4-9bc8-8f39b109bad5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:52.575474 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-08f8ac72-e678-4cb4-9bc8-8f39b109bad5 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1756 microversion: 2.1 time: 0.162216 Aug 31 11:49:52.576035 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 406/814] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:52 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:52.598823 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9db4551b-a8bb-4e28-a5ed-aa4196bafc2d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:52.599426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9db4551b-a8bb-4e28-a5ed-aa4196bafc2d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:52.605370 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9db4551b-a8bb-4e28-a5ed-aa4196bafc2d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:52.605848 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9db4551b-a8bb-4e28-a5ed-aa4196bafc2d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:52.606299 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9db4551b-a8bb-4e28-a5ed-aa4196bafc2d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:52.607040 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9db4551b-a8bb-4e28-a5ed-aa4196bafc2d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:52.607512 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9db4551b-a8bb-4e28-a5ed-aa4196bafc2d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:52.607928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9db4551b-a8bb-4e28-a5ed-aa4196bafc2d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:52.737931 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9db4551b-a8bb-4e28-a5ed-aa4196bafc2d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:52.745527 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9db4551b-a8bb-4e28-a5ed-aa4196bafc2d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1674 microversion: 2.1 time: 0.151333 Aug 31 11:49:52.746112 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 409/815] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:52 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:52.856330 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b410fa92-3225-41c8-97cc-94b793269701 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:52.856962 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b410fa92-3225-41c8-97cc-94b793269701 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:52.862894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b410fa92-3225-41c8-97cc-94b793269701 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:52.863372 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b410fa92-3225-41c8-97cc-94b793269701 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:52.863801 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b410fa92-3225-41c8-97cc-94b793269701 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:52.864483 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b410fa92-3225-41c8-97cc-94b793269701 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:52.864953 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b410fa92-3225-41c8-97cc-94b793269701 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:52.865405 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b410fa92-3225-41c8-97cc-94b793269701 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:52.993598 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b410fa92-3225-41c8-97cc-94b793269701 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:53.002864 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b410fa92-3225-41c8-97cc-94b793269701 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.150143 Aug 31 11:49:53.003690 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 407/816] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:52 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:53.596632 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c45ca76c-7063-4997-9edc-8ae67501513a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:53.597239 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c45ca76c-7063-4997-9edc-8ae67501513a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:53.603148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c45ca76c-7063-4997-9edc-8ae67501513a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:53.603628 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c45ca76c-7063-4997-9edc-8ae67501513a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:53.604072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c45ca76c-7063-4997-9edc-8ae67501513a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:53.604758 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c45ca76c-7063-4997-9edc-8ae67501513a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:53.605205 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c45ca76c-7063-4997-9edc-8ae67501513a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:53.605625 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c45ca76c-7063-4997-9edc-8ae67501513a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:53.747513 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c45ca76c-7063-4997-9edc-8ae67501513a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:53.755754 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c45ca76c-7063-4997-9edc-8ae67501513a tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1756 microversion: 2.1 time: 0.163517 Aug 31 11:49:53.756356 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 410/817] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:53 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:53.766182 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9f2b9f2d-0fde-4ec7-b6f7-aabda76441be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:53.766843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9f2b9f2d-0fde-4ec7-b6f7-aabda76441be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:53.773238 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9f2b9f2d-0fde-4ec7-b6f7-aabda76441be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:53.773710 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9f2b9f2d-0fde-4ec7-b6f7-aabda76441be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:53.774137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9f2b9f2d-0fde-4ec7-b6f7-aabda76441be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:53.774813 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9f2b9f2d-0fde-4ec7-b6f7-aabda76441be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:53.775256 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9f2b9f2d-0fde-4ec7-b6f7-aabda76441be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:53.775672 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9f2b9f2d-0fde-4ec7-b6f7-aabda76441be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:53.905945 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9f2b9f2d-0fde-4ec7-b6f7-aabda76441be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:53.914684 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9f2b9f2d-0fde-4ec7-b6f7-aabda76441be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1674 microversion: 2.1 time: 0.152333 Aug 31 11:49:53.915254 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 408/818] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:53 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:49:54.024064 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-312b1e21-ffbe-41d6-beb1-ad578d00debb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:54.024704 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-312b1e21-ffbe-41d6-beb1-ad578d00debb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:54.030757 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-312b1e21-ffbe-41d6-beb1-ad578d00debb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:54.031262 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-312b1e21-ffbe-41d6-beb1-ad578d00debb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:54.031701 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-312b1e21-ffbe-41d6-beb1-ad578d00debb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:54.033520 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-312b1e21-ffbe-41d6-beb1-ad578d00debb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:54.033973 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-312b1e21-ffbe-41d6-beb1-ad578d00debb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:54.034403 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-312b1e21-ffbe-41d6-beb1-ad578d00debb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:54.170530 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-312b1e21-ffbe-41d6-beb1-ad578d00debb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:54.179303 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-312b1e21-ffbe-41d6-beb1-ad578d00debb tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.159142 Aug 31 11:49:54.179874 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 411/819] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:54 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:49:54.776763 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fcbff215-5f1a-45d3-b83b-a3213b80cbd4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:54.777307 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fcbff215-5f1a-45d3-b83b-a3213b80cbd4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:54.783977 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fcbff215-5f1a-45d3-b83b-a3213b80cbd4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:54.784451 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fcbff215-5f1a-45d3-b83b-a3213b80cbd4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:54.784910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fcbff215-5f1a-45d3-b83b-a3213b80cbd4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:54.785589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fcbff215-5f1a-45d3-b83b-a3213b80cbd4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:54.786030 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fcbff215-5f1a-45d3-b83b-a3213b80cbd4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:54.786454 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fcbff215-5f1a-45d3-b83b-a3213b80cbd4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:54.931756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-fcbff215-5f1a-45d3-b83b-a3213b80cbd4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:54.935220 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-098c6932-e560-46df-8aab-2831fd19a9f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:54.935906 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-098c6932-e560-46df-8aab-2831fd19a9f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:54.940868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-fcbff215-5f1a-45d3-b83b-a3213b80cbd4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1756 microversion: 2.1 time: 0.167959 Aug 31 11:49:54.941436 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 409/820] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:54 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:54.943672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-098c6932-e560-46df-8aab-2831fd19a9f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:54.944218 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-098c6932-e560-46df-8aab-2831fd19a9f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:54.944805 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-098c6932-e560-46df-8aab-2831fd19a9f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:54.945527 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-098c6932-e560-46df-8aab-2831fd19a9f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:54.946045 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-098c6932-e560-46df-8aab-2831fd19a9f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:54.946542 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-098c6932-e560-46df-8aab-2831fd19a9f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:55.073806 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-098c6932-e560-46df-8aab-2831fd19a9f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:55.081919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-098c6932-e560-46df-8aab-2831fd19a9f1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1674 microversion: 2.1 time: 0.150697 Aug 31 11:49:55.082486 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 412/821] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:54 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:55.201527 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8eebbcfe-39ab-4d4d-a9c2-ae00e3ee199a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:55.202128 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8eebbcfe-39ab-4d4d-a9c2-ae00e3ee199a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:55.208114 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8eebbcfe-39ab-4d4d-a9c2-ae00e3ee199a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:55.208618 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8eebbcfe-39ab-4d4d-a9c2-ae00e3ee199a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:55.209049 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8eebbcfe-39ab-4d4d-a9c2-ae00e3ee199a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:55.209724 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8eebbcfe-39ab-4d4d-a9c2-ae00e3ee199a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:55.210165 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8eebbcfe-39ab-4d4d-a9c2-ae00e3ee199a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:55.210648 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8eebbcfe-39ab-4d4d-a9c2-ae00e3ee199a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:55.340097 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8eebbcfe-39ab-4d4d-a9c2-ae00e3ee199a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:55.348853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8eebbcfe-39ab-4d4d-a9c2-ae00e3ee199a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.151078 Aug 31 11:49:55.349422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 410/822] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:55 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:55.963376 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-22fe1db3-7ffb-413c-ac6f-bfc8f3aeafec tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:55.963934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-22fe1db3-7ffb-413c-ac6f-bfc8f3aeafec tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:55.970781 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22fe1db3-7ffb-413c-ac6f-bfc8f3aeafec tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:55.971280 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22fe1db3-7ffb-413c-ac6f-bfc8f3aeafec tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:55.971682 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22fe1db3-7ffb-413c-ac6f-bfc8f3aeafec tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:55.972354 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22fe1db3-7ffb-413c-ac6f-bfc8f3aeafec tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:55.972823 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22fe1db3-7ffb-413c-ac6f-bfc8f3aeafec tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:55.973235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22fe1db3-7ffb-413c-ac6f-bfc8f3aeafec tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:56.103175 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d30644b2-8677-4b55-9c29-6c0390533dcc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:56.103860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d30644b2-8677-4b55-9c29-6c0390533dcc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:56.110236 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d30644b2-8677-4b55-9c29-6c0390533dcc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:56.110810 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d30644b2-8677-4b55-9c29-6c0390533dcc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:56.111299 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d30644b2-8677-4b55-9c29-6c0390533dcc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:56.112045 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d30644b2-8677-4b55-9c29-6c0390533dcc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:56.112599 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d30644b2-8677-4b55-9c29-6c0390533dcc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:56.113016 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d30644b2-8677-4b55-9c29-6c0390533dcc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:56.118055 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-22fe1db3-7ffb-413c-ac6f-bfc8f3aeafec tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:56.127565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-22fe1db3-7ffb-413c-ac6f-bfc8f3aeafec tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1756 microversion: 2.1 time: 0.168896 Aug 31 11:49:56.128334 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 413/823] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:55 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:56.242163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d30644b2-8677-4b55-9c29-6c0390533dcc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:56.245637 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:49:56.250597 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d30644b2-8677-4b55-9c29-6c0390533dcc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1674 microversion: 2.1 time: 0.151311 Aug 31 11:49:56.251986 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 411/824] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:56 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:49:56.372805 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-49fc7893-6b74-4142-a878-8eeb1203b485 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:56.373408 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-49fc7893-6b74-4142-a878-8eeb1203b485 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:56.380363 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-49fc7893-6b74-4142-a878-8eeb1203b485 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:56.380884 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-49fc7893-6b74-4142-a878-8eeb1203b485 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:56.381321 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-49fc7893-6b74-4142-a878-8eeb1203b485 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:56.382014 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-49fc7893-6b74-4142-a878-8eeb1203b485 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:56.382465 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-49fc7893-6b74-4142-a878-8eeb1203b485 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:56.382892 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-49fc7893-6b74-4142-a878-8eeb1203b485 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:56.387071 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:49:56.515210 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-49fc7893-6b74-4142-a878-8eeb1203b485 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:56.523508 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-49fc7893-6b74-4142-a878-8eeb1203b485 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.154592 Aug 31 11:49:56.524093 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 414/825] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:56 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:57.149599 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-03b1acb7-0aec-4850-a7dd-41a076ce017d tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:57.150198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-03b1acb7-0aec-4850-a7dd-41a076ce017d tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:57.158105 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-03b1acb7-0aec-4850-a7dd-41a076ce017d tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:57.159065 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-03b1acb7-0aec-4850-a7dd-41a076ce017d tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:57.159501 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-03b1acb7-0aec-4850-a7dd-41a076ce017d tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:57.160201 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-03b1acb7-0aec-4850-a7dd-41a076ce017d tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:57.160664 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-03b1acb7-0aec-4850-a7dd-41a076ce017d tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:57.161082 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-03b1acb7-0aec-4850-a7dd-41a076ce017d tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:57.273806 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5b173d9b-d4cb-44eb-ad97-35c4946f5093 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:57.274527 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5b173d9b-d4cb-44eb-ad97-35c4946f5093 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:57.281407 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5b173d9b-d4cb-44eb-ad97-35c4946f5093 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:57.281716 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5b173d9b-d4cb-44eb-ad97-35c4946f5093 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:57.282758 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5b173d9b-d4cb-44eb-ad97-35c4946f5093 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:57.284117 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5b173d9b-d4cb-44eb-ad97-35c4946f5093 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:57.284677 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5b173d9b-d4cb-44eb-ad97-35c4946f5093 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:57.285174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5b173d9b-d4cb-44eb-ad97-35c4946f5093 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:57.310382 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-03b1acb7-0aec-4850-a7dd-41a076ce017d tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:57.319139 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-03b1acb7-0aec-4850-a7dd-41a076ce017d tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1756 microversion: 2.1 time: 0.174204 Aug 31 11:49:57.319945 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 412/826] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:57 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:57.416864 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5b173d9b-d4cb-44eb-ad97-35c4946f5093 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:57.425338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5b173d9b-d4cb-44eb-ad97-35c4946f5093 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1674 microversion: 2.1 time: 0.155457 Aug 31 11:49:57.425906 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 415/827] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:57 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:49:57.544473 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3faac9a9-79f8-488e-9eb9-c3d032dfd5ca tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:57.545093 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3faac9a9-79f8-488e-9eb9-c3d032dfd5ca tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:57.551091 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3faac9a9-79f8-488e-9eb9-c3d032dfd5ca tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:57.551565 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3faac9a9-79f8-488e-9eb9-c3d032dfd5ca tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:57.551988 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3faac9a9-79f8-488e-9eb9-c3d032dfd5ca tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:57.552690 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3faac9a9-79f8-488e-9eb9-c3d032dfd5ca tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:57.553130 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3faac9a9-79f8-488e-9eb9-c3d032dfd5ca tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:57.553543 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3faac9a9-79f8-488e-9eb9-c3d032dfd5ca tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:57.683344 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3faac9a9-79f8-488e-9eb9-c3d032dfd5ca tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:57.692393 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3faac9a9-79f8-488e-9eb9-c3d032dfd5ca tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.151664 Aug 31 11:49:57.693242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 413/828] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:57 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:49:58.340235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6bbf1343-bce1-42b9-9eb4-8b63b0744a76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:58.340915 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6bbf1343-bce1-42b9-9eb4-8b63b0744a76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:58.347879 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6bbf1343-bce1-42b9-9eb4-8b63b0744a76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:58.348352 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6bbf1343-bce1-42b9-9eb4-8b63b0744a76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:58.348808 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6bbf1343-bce1-42b9-9eb4-8b63b0744a76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:58.349493 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6bbf1343-bce1-42b9-9eb4-8b63b0744a76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:58.349940 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6bbf1343-bce1-42b9-9eb4-8b63b0744a76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:58.350362 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6bbf1343-bce1-42b9-9eb4-8b63b0744a76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:58.446212 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3f42c56d-a391-4098-ad19-88a62a8871e8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:58.446815 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3f42c56d-a391-4098-ad19-88a62a8871e8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:58.453129 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3f42c56d-a391-4098-ad19-88a62a8871e8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:58.453623 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3f42c56d-a391-4098-ad19-88a62a8871e8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:58.454210 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3f42c56d-a391-4098-ad19-88a62a8871e8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:58.454907 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3f42c56d-a391-4098-ad19-88a62a8871e8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:58.455355 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3f42c56d-a391-4098-ad19-88a62a8871e8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:58.455780 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3f42c56d-a391-4098-ad19-88a62a8871e8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:58.503897 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6bbf1343-bce1-42b9-9eb4-8b63b0744a76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:58.512387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6bbf1343-bce1-42b9-9eb4-8b63b0744a76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1756 microversion: 2.1 time: 0.176003 Aug 31 11:49:58.513090 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 416/829] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:58 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:58.593701 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3f42c56d-a391-4098-ad19-88a62a8871e8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:58.602335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3f42c56d-a391-4098-ad19-88a62a8871e8 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1674 microversion: 2.1 time: 0.160169 Aug 31 11:49:58.602894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 414/830] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:58 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:49:58.714048 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-804942ab-3815-4a35-8435-11b9b9d7d346 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:58.714688 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-804942ab-3815-4a35-8435-11b9b9d7d346 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:58.721473 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-804942ab-3815-4a35-8435-11b9b9d7d346 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:58.721952 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-804942ab-3815-4a35-8435-11b9b9d7d346 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:58.722382 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-804942ab-3815-4a35-8435-11b9b9d7d346 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:58.723071 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-804942ab-3815-4a35-8435-11b9b9d7d346 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:58.723520 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-804942ab-3815-4a35-8435-11b9b9d7d346 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:58.723943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-804942ab-3815-4a35-8435-11b9b9d7d346 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:58.850963 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-804942ab-3815-4a35-8435-11b9b9d7d346 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:58.859255 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-804942ab-3815-4a35-8435-11b9b9d7d346 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.149052 Aug 31 11:49:58.859822 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 417/831] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:58 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:59.534145 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-dc72ccb1-6052-49cc-89b3-2f3f83bad6e4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:59.534694 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-dc72ccb1-6052-49cc-89b3-2f3f83bad6e4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:59.536657 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 11:49:59.536794 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Wed Aug 31 11:49:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 (ip 10.222.0.60) !!! Aug 31 11:49:59.543331 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dc72ccb1-6052-49cc-89b3-2f3f83bad6e4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:59.543802 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dc72ccb1-6052-49cc-89b3-2f3f83bad6e4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:59.544226 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dc72ccb1-6052-49cc-89b3-2f3f83bad6e4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:59.544926 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dc72ccb1-6052-49cc-89b3-2f3f83bad6e4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:59.545363 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dc72ccb1-6052-49cc-89b3-2f3f83bad6e4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:59.545774 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dc72ccb1-6052-49cc-89b3-2f3f83bad6e4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:59.623576 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-87604dba-88a7-4c53-90c6-4a61b2fc3ad5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:59.624309 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-87604dba-88a7-4c53-90c6-4a61b2fc3ad5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:59.632049 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87604dba-88a7-4c53-90c6-4a61b2fc3ad5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:59.632651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87604dba-88a7-4c53-90c6-4a61b2fc3ad5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:59.633152 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87604dba-88a7-4c53-90c6-4a61b2fc3ad5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:59.633924 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87604dba-88a7-4c53-90c6-4a61b2fc3ad5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:59.634454 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87604dba-88a7-4c53-90c6-4a61b2fc3ad5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:59.634943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-87604dba-88a7-4c53-90c6-4a61b2fc3ad5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:59.694626 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-dc72ccb1-6052-49cc-89b3-2f3f83bad6e4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:59.702892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-dc72ccb1-6052-49cc-89b3-2f3f83bad6e4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1756 microversion: 2.1 time: 0.172681 Aug 31 11:49:59.703479 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 415/832] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:59 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:49:59.784919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-87604dba-88a7-4c53-90c6-4a61b2fc3ad5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:49:59.792551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-87604dba-88a7-4c53-90c6-4a61b2fc3ad5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1674 microversion: 2.1 time: 0.172904 Aug 31 11:49:59.793213 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 418/833] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:59 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:49:59.881593 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5c97e2be-f50d-41a2-a882-36c1accf6164 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:49:59.882197 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5c97e2be-f50d-41a2-a882-36c1accf6164 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:49:59.888008 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5c97e2be-f50d-41a2-a882-36c1accf6164 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:59.888509 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5c97e2be-f50d-41a2-a882-36c1accf6164 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:59.888954 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5c97e2be-f50d-41a2-a882-36c1accf6164 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:49:59.889634 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5c97e2be-f50d-41a2-a882-36c1accf6164 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:49:59.890084 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5c97e2be-f50d-41a2-a882-36c1accf6164 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:49:59.890508 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5c97e2be-f50d-41a2-a882-36c1accf6164 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:00.032130 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5c97e2be-f50d-41a2-a882-36c1accf6164 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:00.040282 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5c97e2be-f50d-41a2-a882-36c1accf6164 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.162691 Aug 31 11:50:00.040875 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 416/834] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:49:59 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:00.786178 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c3c8363b-dde8-4fcb-a7b0-7b8efe794a22 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:00.786785 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c3c8363b-dde8-4fcb-a7b0-7b8efe794a22 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:00.792759 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c3c8363b-dde8-4fcb-a7b0-7b8efe794a22 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:00.793238 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c3c8363b-dde8-4fcb-a7b0-7b8efe794a22 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:00.793672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c3c8363b-dde8-4fcb-a7b0-7b8efe794a22 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:00.794358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c3c8363b-dde8-4fcb-a7b0-7b8efe794a22 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:00.794804 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c3c8363b-dde8-4fcb-a7b0-7b8efe794a22 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:00.795232 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c3c8363b-dde8-4fcb-a7b0-7b8efe794a22 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:00.821786 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9dabc67c-b431-4a31-a504-c0ba77dc2608 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:00.822523 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9dabc67c-b431-4a31-a504-c0ba77dc2608 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:00.830163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9dabc67c-b431-4a31-a504-c0ba77dc2608 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:00.831051 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9dabc67c-b431-4a31-a504-c0ba77dc2608 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:00.831177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9dabc67c-b431-4a31-a504-c0ba77dc2608 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:00.831789 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9dabc67c-b431-4a31-a504-c0ba77dc2608 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:00.832233 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9dabc67c-b431-4a31-a504-c0ba77dc2608 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:00.832682 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9dabc67c-b431-4a31-a504-c0ba77dc2608 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:00.942347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c3c8363b-dde8-4fcb-a7b0-7b8efe794a22 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:00.950745 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c3c8363b-dde8-4fcb-a7b0-7b8efe794a22 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1756 microversion: 2.1 time: 0.169018 Aug 31 11:50:00.951316 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 419/835] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:00 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:00.964687 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9dabc67c-b431-4a31-a504-c0ba77dc2608 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:00.972790 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9dabc67c-b431-4a31-a504-c0ba77dc2608 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1674 microversion: 2.1 time: 0.162955 Aug 31 11:50:00.973350 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 417/836] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:00 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:50:01.062064 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2eb4d3b8-b5a5-44eb-87e4-a8e152d5e181 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:01.062676 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2eb4d3b8-b5a5-44eb-87e4-a8e152d5e181 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:01.069310 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2eb4d3b8-b5a5-44eb-87e4-a8e152d5e181 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:01.069796 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2eb4d3b8-b5a5-44eb-87e4-a8e152d5e181 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:01.070233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2eb4d3b8-b5a5-44eb-87e4-a8e152d5e181 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:01.070925 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2eb4d3b8-b5a5-44eb-87e4-a8e152d5e181 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:01.071377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2eb4d3b8-b5a5-44eb-87e4-a8e152d5e181 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:01.071802 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2eb4d3b8-b5a5-44eb-87e4-a8e152d5e181 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:01.201627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2eb4d3b8-b5a5-44eb-87e4-a8e152d5e181 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:01.210009 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2eb4d3b8-b5a5-44eb-87e4-a8e152d5e181 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.151913 Aug 31 11:50:01.210619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 420/837] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:01 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:01.972670 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-dec31fe9-f7b5-403c-886a-186ef23127f8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:01.973237 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-dec31fe9-f7b5-403c-886a-186ef23127f8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:01.979571 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dec31fe9-f7b5-403c-886a-186ef23127f8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:01.980074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dec31fe9-f7b5-403c-886a-186ef23127f8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:01.980519 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dec31fe9-f7b5-403c-886a-186ef23127f8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:01.981198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dec31fe9-f7b5-403c-886a-186ef23127f8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:01.981667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dec31fe9-f7b5-403c-886a-186ef23127f8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:01.982086 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-dec31fe9-f7b5-403c-886a-186ef23127f8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:01.994016 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-24c24d6c-499d-473c-b4f9-6a9bce142001 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:01.994665 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-24c24d6c-499d-473c-b4f9-6a9bce142001 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:02.001752 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-24c24d6c-499d-473c-b4f9-6a9bce142001 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:02.002250 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-24c24d6c-499d-473c-b4f9-6a9bce142001 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:02.002732 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-24c24d6c-499d-473c-b4f9-6a9bce142001 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:02.003437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-24c24d6c-499d-473c-b4f9-6a9bce142001 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:02.003908 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-24c24d6c-499d-473c-b4f9-6a9bce142001 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:02.004387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-24c24d6c-499d-473c-b4f9-6a9bce142001 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:02.124177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-dec31fe9-f7b5-403c-886a-186ef23127f8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:02.133475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-dec31fe9-f7b5-403c-886a-186ef23127f8 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1756 microversion: 2.1 time: 0.164839 Aug 31 11:50:02.134148 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 418/838] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:01 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:02.137254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-24c24d6c-499d-473c-b4f9-6a9bce142001 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:02.145734 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-24c24d6c-499d-473c-b4f9-6a9bce142001 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1651 microversion: 2.1 time: 0.155448 Aug 31 11:50:02.146308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 421/839] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:01 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1651 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:50:02.166619 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2d49aa85-a134-47fa-a90b-e28ee2fbf401 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:02.173174 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d49aa85-a134-47fa-a90b-e28ee2fbf401 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:02.173654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d49aa85-a134-47fa-a90b-e28ee2fbf401 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:02.174081 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d49aa85-a134-47fa-a90b-e28ee2fbf401 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:02.196326 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2d49aa85-a134-47fa-a90b-e28ee2fbf401 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Going to try to start instance {{(pid=127061) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 11:50:02.231608 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b948df7d-7c4f-43a5-b983-13e566196c65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:02.232352 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b948df7d-7c4f-43a5-b983-13e566196c65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:02.237524 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2d49aa85-a134-47fa-a90b-e28ee2fbf401 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "POST /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/action" status: 202 len: 0 microversion: 2.1 time: 0.074308 Aug 31 11:50:02.238219 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 419/840] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 31 11:50:02 2022] POST /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:50:02.239352 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b948df7d-7c4f-43a5-b983-13e566196c65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:02.239840 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b948df7d-7c4f-43a5-b983-13e566196c65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:02.240276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b948df7d-7c4f-43a5-b983-13e566196c65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:02.241065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b948df7d-7c4f-43a5-b983-13e566196c65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:02.241523 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b948df7d-7c4f-43a5-b983-13e566196c65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:02.241974 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b948df7d-7c4f-43a5-b983-13e566196c65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:02.247085 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-51718163-1dea-41a0-8750-96a40810c7be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:02.247806 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-51718163-1dea-41a0-8750-96a40810c7be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:02.256313 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-51718163-1dea-41a0-8750-96a40810c7be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:02.256832 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-51718163-1dea-41a0-8750-96a40810c7be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:02.257300 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-51718163-1dea-41a0-8750-96a40810c7be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:02.258002 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-51718163-1dea-41a0-8750-96a40810c7be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:02.258457 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-51718163-1dea-41a0-8750-96a40810c7be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:02.259489 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-51718163-1dea-41a0-8750-96a40810c7be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:02.404321 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-51718163-1dea-41a0-8750-96a40810c7be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:02.414311 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-51718163-1dea-41a0-8750-96a40810c7be tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1660 microversion: 2.1 time: 0.171504 Aug 31 11:50:02.414892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 420/841] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:02 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1660 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:50:02.416097 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b948df7d-7c4f-43a5-b983-13e566196c65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:02.424767 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b948df7d-7c4f-43a5-b983-13e566196c65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.197479 Aug 31 11:50:02.425330 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 422/842] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:02 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:50:03.155120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6ce46cd1-5cdf-4d18-9ec7-f6bcebb8c647 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:03.155726 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6ce46cd1-5cdf-4d18-9ec7-f6bcebb8c647 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:03.162347 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ce46cd1-5cdf-4d18-9ec7-f6bcebb8c647 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:03.162826 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ce46cd1-5cdf-4d18-9ec7-f6bcebb8c647 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:03.163265 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ce46cd1-5cdf-4d18-9ec7-f6bcebb8c647 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:03.163954 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ce46cd1-5cdf-4d18-9ec7-f6bcebb8c647 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:03.164403 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ce46cd1-5cdf-4d18-9ec7-f6bcebb8c647 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:03.164854 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ce46cd1-5cdf-4d18-9ec7-f6bcebb8c647 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:03.309325 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6ce46cd1-5cdf-4d18-9ec7-f6bcebb8c647 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:03.318774 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6ce46cd1-5cdf-4d18-9ec7-f6bcebb8c647 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1759 microversion: 2.1 time: 0.167570 Aug 31 11:50:03.319346 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 421/843] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:03 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:03.435734 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8e5d3881-bf51-4a21-bd27-3db33a23617c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:03.436309 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8e5d3881-bf51-4a21-bd27-3db33a23617c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:03.443712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e5d3881-bf51-4a21-bd27-3db33a23617c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:03.444185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e5d3881-bf51-4a21-bd27-3db33a23617c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:03.444647 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e5d3881-bf51-4a21-bd27-3db33a23617c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:03.445335 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e5d3881-bf51-4a21-bd27-3db33a23617c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:03.445477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f9c53a2f-28ab-4eee-8a97-f4bf27a6ce0a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:03.445778 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e5d3881-bf51-4a21-bd27-3db33a23617c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:03.446077 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f9c53a2f-28ab-4eee-8a97-f4bf27a6ce0a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:03.446180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e5d3881-bf51-4a21-bd27-3db33a23617c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:03.451791 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f9c53a2f-28ab-4eee-8a97-f4bf27a6ce0a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:03.452275 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f9c53a2f-28ab-4eee-8a97-f4bf27a6ce0a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:03.452747 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f9c53a2f-28ab-4eee-8a97-f4bf27a6ce0a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:03.453435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f9c53a2f-28ab-4eee-8a97-f4bf27a6ce0a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:03.454525 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f9c53a2f-28ab-4eee-8a97-f4bf27a6ce0a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:03.454951 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f9c53a2f-28ab-4eee-8a97-f4bf27a6ce0a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:03.591642 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8e5d3881-bf51-4a21-bd27-3db33a23617c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:03.598514 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f9c53a2f-28ab-4eee-8a97-f4bf27a6ce0a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:03.600918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8e5d3881-bf51-4a21-bd27-3db33a23617c tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1660 microversion: 2.1 time: 0.169029 Aug 31 11:50:03.605030 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 423/844] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:03 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1660 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:03.606658 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f9c53a2f-28ab-4eee-8a97-f4bf27a6ce0a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.165164 Aug 31 11:50:03.607211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 422/845] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:03 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:50:04.622970 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-53b9f6b2-badb-4c5c-aa16-90fdd01d39ad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:04.623556 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-53b9f6b2-badb-4c5c-aa16-90fdd01d39ad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:04.629269 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-53738a7f-e373-48b0-803a-d4009d960ae5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:04.629915 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-53738a7f-e373-48b0-803a-d4009d960ae5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:04.632161 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-53b9f6b2-badb-4c5c-aa16-90fdd01d39ad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:04.633160 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-53b9f6b2-badb-4c5c-aa16-90fdd01d39ad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:04.634234 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-53b9f6b2-badb-4c5c-aa16-90fdd01d39ad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:04.635160 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-53b9f6b2-badb-4c5c-aa16-90fdd01d39ad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:04.635802 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-53b9f6b2-badb-4c5c-aa16-90fdd01d39ad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:04.636443 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-53b9f6b2-badb-4c5c-aa16-90fdd01d39ad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:04.637216 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-53738a7f-e373-48b0-803a-d4009d960ae5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:04.637797 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-53738a7f-e373-48b0-803a-d4009d960ae5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:04.638718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-53738a7f-e373-48b0-803a-d4009d960ae5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:04.639433 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-53738a7f-e373-48b0-803a-d4009d960ae5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:04.639886 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-53738a7f-e373-48b0-803a-d4009d960ae5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:04.640313 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-53738a7f-e373-48b0-803a-d4009d960ae5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:04.774021 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-53b9f6b2-badb-4c5c-aa16-90fdd01d39ad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:04.779146 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-53738a7f-e373-48b0-803a-d4009d960ae5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:04.782745 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-53b9f6b2-badb-4c5c-aa16-90fdd01d39ad tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1664 microversion: 2.1 time: 0.162789 Aug 31 11:50:04.788111 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-53738a7f-e373-48b0-803a-d4009d960ae5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.164129 Aug 31 11:50:04.788803 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 423/847] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:04 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:04.789052 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 424/847] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:04 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:05.810387 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f81bc00e-0b64-44ec-aad4-0508cee2996f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:05.811032 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f81bc00e-0b64-44ec-aad4-0508cee2996f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:05.817364 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f81bc00e-0b64-44ec-aad4-0508cee2996f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:05.818098 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f81bc00e-0b64-44ec-aad4-0508cee2996f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:05.818520 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f81bc00e-0b64-44ec-aad4-0508cee2996f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:05.819192 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f81bc00e-0b64-44ec-aad4-0508cee2996f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:05.819630 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f81bc00e-0b64-44ec-aad4-0508cee2996f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:05.820040 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f81bc00e-0b64-44ec-aad4-0508cee2996f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:05.946442 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f81bc00e-0b64-44ec-aad4-0508cee2996f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:05.955196 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f81bc00e-0b64-44ec-aad4-0508cee2996f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.148520 Aug 31 11:50:05.955748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 424/848] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:05 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:06.976102 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-17e89cf1-a9ce-45dd-96f1-d49d8cac1635 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:06.976660 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-17e89cf1-a9ce-45dd-96f1-d49d8cac1635 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:06.983163 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-17e89cf1-a9ce-45dd-96f1-d49d8cac1635 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:06.983633 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-17e89cf1-a9ce-45dd-96f1-d49d8cac1635 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:06.984061 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-17e89cf1-a9ce-45dd-96f1-d49d8cac1635 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:06.985302 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-17e89cf1-a9ce-45dd-96f1-d49d8cac1635 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:06.985746 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-17e89cf1-a9ce-45dd-96f1-d49d8cac1635 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:06.986164 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-17e89cf1-a9ce-45dd-96f1-d49d8cac1635 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:07.121835 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-17e89cf1-a9ce-45dd-96f1-d49d8cac1635 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:07.131022 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-17e89cf1-a9ce-45dd-96f1-d49d8cac1635 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.158780 Aug 31 11:50:07.131635 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 425/849] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:06 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:50:08.151210 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-14edeb15-9fc9-4baa-a2c1-d3f1e0a71a08 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:08.151817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-14edeb15-9fc9-4baa-a2c1-d3f1e0a71a08 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:08.158407 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-14edeb15-9fc9-4baa-a2c1-d3f1e0a71a08 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:08.158886 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-14edeb15-9fc9-4baa-a2c1-d3f1e0a71a08 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:08.159319 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-14edeb15-9fc9-4baa-a2c1-d3f1e0a71a08 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:08.160005 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-14edeb15-9fc9-4baa-a2c1-d3f1e0a71a08 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:08.160454 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-14edeb15-9fc9-4baa-a2c1-d3f1e0a71a08 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:08.160902 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-14edeb15-9fc9-4baa-a2c1-d3f1e0a71a08 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:08.290682 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-14edeb15-9fc9-4baa-a2c1-d3f1e0a71a08 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:08.299396 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-14edeb15-9fc9-4baa-a2c1-d3f1e0a71a08 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1735 microversion: 2.1 time: 0.152049 Aug 31 11:50:08.299957 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 425/850] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:08 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:08.551010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e6d46fda-eb69-40e4-a380-00ef8dd5671f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:08.551507 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e6d46fda-eb69-40e4-a380-00ef8dd5671f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:08.557562 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e6d46fda-eb69-40e4-a380-00ef8dd5671f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:08.558041 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e6d46fda-eb69-40e4-a380-00ef8dd5671f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:08.558474 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e6d46fda-eb69-40e4-a380-00ef8dd5671f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:08.559160 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e6d46fda-eb69-40e4-a380-00ef8dd5671f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:08.559612 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e6d46fda-eb69-40e4-a380-00ef8dd5671f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:08.560038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e6d46fda-eb69-40e4-a380-00ef8dd5671f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:08.583985 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e6d46fda-eb69-40e4-a380-00ef8dd5671f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be/ips" status: 200 len: 149 microversion: 2.1 time: 0.141318 Aug 31 11:50:08.584571 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 426/851] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 31 11:50:08 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be/ips => generated 149 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:50:08.596389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-31779a80-d6af-41f4-b224-eebda781a24b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ba03f5f-7e61-49f0-a1e0-80cafa355d18"}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:08.598864 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-31779a80-d6af-41f4-b224-eebda781a24b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:08.604735 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31779a80-d6af-41f4-b224-eebda781a24b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:08.605210 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31779a80-d6af-41f4-b224-eebda781a24b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:08.605637 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31779a80-d6af-41f4-b224-eebda781a24b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:08.606308 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31779a80-d6af-41f4-b224-eebda781a24b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:08.606747 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31779a80-d6af-41f4-b224-eebda781a24b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:08.607159 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-31779a80-d6af-41f4-b224-eebda781a24b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:08.687541 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-31779a80-d6af-41f4-b224-eebda781a24b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] HTTP exception thrown: Invalid volume: volume 9ba03f5f-7e61-49f0-a1e0-80cafa355d18 is already attached to instances: ece59cd5-8579-4406-be68-9d0204aeb446 Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-31779a80-d6af-41f4-b224-eebda781a24b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Request method failure captured: Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: POST /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be/os-volume_attachments HTTP/1.1 Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 74 Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lNZK36WRJOqsZNJl20dtBROIhvCChjxxXw9hostbElDCeoQYmhRnMS-kPydTDnhED92nvTRK2Z-mbhSicQnNG72V_XHtUyBJEP0Dy5LBQs28qt-qUXpO9451h3L1SwnxBkofz4240mv6LO2saJFZwry8omihvYKRxBlQ5VwAkEiuA Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:50:08.689860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:50:08.691475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4ac4dc41f7e420d811483990e020f22", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}] Aug 31 11:50:08.691475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:50:08.691475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:50:08.691475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:50:08.691475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:50:08.691475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:50:08.691475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:50:08.691475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 5de832888ffd4a69ae88cac6b632304e Aug 31 11:50:08.691475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:50:08.691475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Aug 31 11:50:08.691475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {"volumeAttachment": {"volumeId": "9ba03f5f-7e61-49f0-a1e0-80cafa355d18"}} Aug 31 11:50:08.691475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Invalid volume: volume 9ba03f5f-7e61-49f0-a1e0-80cafa355d18 is already attached to instances: ece59cd5-8579-4406-be68-9d0204aeb446 Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'server_id': '89973a85-9500-443c-b017-ceeb73cfc3be', 'body': {'volumeAttachment': {'volumeId': '9ba03f5f-7e61-49f0-a1e0-80cafa355d18'}}} Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9ba03f5f-7e61-49f0-a1e0-80cafa355d18 is already attached to instances: ece59cd5-8579-4406-be68-9d0204aeb446 Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:08.692435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9ba03f5f-7e61-49f0-a1e0-80cafa355d18 is already attached to instances: ece59cd5-8579-4406-be68-9d0204aeb446 Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:50:08.694335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:50:08.695843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:50:08.695843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:50:08.695843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:50:08.695843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9ba03f5f-7e61-49f0-a1e0-80cafa355d18 is already attached to instances: ece59cd5-8579-4406-be68-9d0204aeb446 Aug 31 11:50:08.695843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:08.695843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-31779a80-d6af-41f4-b224-eebda781a24b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Returning 400 to user: Invalid volume: volume 9ba03f5f-7e61-49f0-a1e0-80cafa355d18 is already attached to instances: ece59cd5-8579-4406-be68-9d0204aeb446 {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:50:08.695843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-31779a80-d6af-41f4-b224-eebda781a24b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "POST /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099489 Aug 31 11:50:08.695843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 426/852] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 31 11:50:08 2022] POST /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:50:08.700398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d8653d0d-edbe-41f3-a2a0-9972524e3f14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:08.700871 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d8653d0d-edbe-41f3-a2a0-9972524e3f14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:08.707204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8653d0d-edbe-41f3-a2a0-9972524e3f14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:08.707685 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8653d0d-edbe-41f3-a2a0-9972524e3f14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:08.708116 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8653d0d-edbe-41f3-a2a0-9972524e3f14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:08.708837 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8653d0d-edbe-41f3-a2a0-9972524e3f14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:08.709291 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8653d0d-edbe-41f3-a2a0-9972524e3f14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:08.709709 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8653d0d-edbe-41f3-a2a0-9972524e3f14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:08.735230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d8653d0d-edbe-41f3-a2a0-9972524e3f14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Going to try to terminate instance {{(pid=127062) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:50:08.811425 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d8653d0d-edbe-41f3-a2a0-9972524e3f14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "DELETE /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 204 len: 0 microversion: 2.1 time: 0.114572 Aug 31 11:50:08.812135 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 427/853] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:50:08 2022] DELETE /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:50:08.821093 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4d94ef7c-745d-4382-a7a3-c2b162561929 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:08.821698 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4d94ef7c-745d-4382-a7a3-c2b162561929 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:08.828633 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d94ef7c-745d-4382-a7a3-c2b162561929 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:08.829445 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d94ef7c-745d-4382-a7a3-c2b162561929 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:08.829874 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d94ef7c-745d-4382-a7a3-c2b162561929 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:08.830587 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d94ef7c-745d-4382-a7a3-c2b162561929 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:08.831049 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d94ef7c-745d-4382-a7a3-c2b162561929 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:08.831471 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d94ef7c-745d-4382-a7a3-c2b162561929 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:08.851062 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:50:08.965812 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4d94ef7c-745d-4382-a7a3-c2b162561929 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:08.973552 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4d94ef7c-745d-4382-a7a3-c2b162561929 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1681 microversion: 2.1 time: 0.156591 Aug 31 11:50:08.974109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 427/854] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:08 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:09.323194 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e1ae9088-cb1e-4826-975b-86601a7354b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:09.323894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e1ae9088-cb1e-4826-975b-86601a7354b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:09.325853 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:50:09.331642 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e1ae9088-cb1e-4826-975b-86601a7354b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:09.332129 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e1ae9088-cb1e-4826-975b-86601a7354b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:09.332608 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e1ae9088-cb1e-4826-975b-86601a7354b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:09.333298 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e1ae9088-cb1e-4826-975b-86601a7354b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:09.333754 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e1ae9088-cb1e-4826-975b-86601a7354b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:09.334178 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e1ae9088-cb1e-4826-975b-86601a7354b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:09.474132 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e1ae9088-cb1e-4826-975b-86601a7354b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:09.482422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e1ae9088-cb1e-4826-975b-86601a7354b7 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1715 microversion: 2.1 time: 0.163454 Aug 31 11:50:09.482993 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 428/855] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:09 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:09.590538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8bac9068-5eaf-413f-8030-83645b8c9f6d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:09.591038 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8bac9068-5eaf-413f-8030-83645b8c9f6d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:09.597993 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8bac9068-5eaf-413f-8030-83645b8c9f6d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:09.598472 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8bac9068-5eaf-413f-8030-83645b8c9f6d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:09.598909 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8bac9068-5eaf-413f-8030-83645b8c9f6d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:09.599595 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8bac9068-5eaf-413f-8030-83645b8c9f6d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:09.600043 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8bac9068-5eaf-413f-8030-83645b8c9f6d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:09.600463 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8bac9068-5eaf-413f-8030-83645b8c9f6d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:09.684157 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-8bac9068-5eaf-413f-8030-83645b8c9f6d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] HTTP exception thrown: Cannot 'detach_volume' instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 while it is in vm_state rescued Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8bac9068-5eaf-413f-8030-83645b8c9f6d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Request method failure captured: Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: DELETE /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments/24674540-4608-45ff-8b48-edbb0a120d1e HTTP/1.1 Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lTBYSI4Ellx1xSTrjGIoKiHgxhum85uyJe7v4p_7ezDgEUywOkeRvVgpwndDzyP6iljpAIyETuLAQabjcJl_KtU2r016DHL9lHZfhqzY9WRA62hsyCCf3I5xWBvvNZ5KLZHqUR5mR5wFwxzMbvDmChRreNmXS89FadI3ywt7qNUEw Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: 0e110109075848a89e6ae1d516de9784 Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2086882469 Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:50:09.685696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:50:09.687274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0e110109075848a89e6ae1d516de9784", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0e110109075848a89e6ae1d516de9784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e110109075848a89e6ae1d516de9784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e110109075848a89e6ae1d516de9784"}]}] Aug 31 11:50:09.687274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2086882469 Aug 31 11:50:09.687274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: 0e110109075848a89e6ae1d516de9784 Aug 31 11:50:09.687274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2086882469 Aug 31 11:50:09.687274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-ServerRescueNegativeTestJSON-2086882469-project Aug 31 11:50:09.687274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:50:09.687274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:50:09.687274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 38ea91bf04e741c793e4a06db9fb046f Aug 31 11:50:09.687274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2086882469-project Aug 31 11:50:09.687274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:50:09.687274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Cannot 'detach_volume' instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 while it is in vm_state rescued Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'server_id': '7a75232d-2df1-41c7-b73d-762fba8bd8e6', 'id': '24674540-4608-45ff-8b48-edbb0a120d1e'} Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:50:09.688113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 while it is in vm_state rescued Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 while it is in vm_state rescued Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:09.689409 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8bac9068-5eaf-413f-8030-83645b8c9f6d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Returning 409 to user: Cannot 'detach_volume' instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 while it is in vm_state rescued {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:50:09.690452 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8bac9068-5eaf-413f-8030-83645b8c9f6d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments/24674540-4608-45ff-8b48-edbb0a120d1e" status: 409 len: 152 microversion: 2.1 time: 0.101198 Aug 31 11:50:09.690452 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 428/856] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 31 11:50:09 2022] DELETE /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments/24674540-4608-45ff-8b48-edbb0a120d1e => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 11:50:09.697473 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b4e47386-0b63-49d1-ac10-4d0f0e9b6c8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:09.697990 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b4e47386-0b63-49d1-ac10-4d0f0e9b6c8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:09.704622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b4e47386-0b63-49d1-ac10-4d0f0e9b6c8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:09.705105 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b4e47386-0b63-49d1-ac10-4d0f0e9b6c8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:09.705532 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b4e47386-0b63-49d1-ac10-4d0f0e9b6c8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:09.706211 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b4e47386-0b63-49d1-ac10-4d0f0e9b6c8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:09.706657 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b4e47386-0b63-49d1-ac10-4d0f0e9b6c8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:09.707078 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b4e47386-0b63-49d1-ac10-4d0f0e9b6c8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:09.724665 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:50:09.775378 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b4e47386-0b63-49d1-ac10-4d0f0e9b6c8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "POST /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/action" status: 202 len: 0 microversion: 2.1 time: 0.081579 Aug 31 11:50:09.776530 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 429/857] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 31 11:50:09 2022] POST /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:50:09.784839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a8382bf2-2653-4dcb-bb2c-6ea5e4744ef5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:09.785446 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a8382bf2-2653-4dcb-bb2c-6ea5e4744ef5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:09.791370 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a8382bf2-2653-4dcb-bb2c-6ea5e4744ef5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:09.791852 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a8382bf2-2653-4dcb-bb2c-6ea5e4744ef5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:09.792284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a8382bf2-2653-4dcb-bb2c-6ea5e4744ef5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:09.792999 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a8382bf2-2653-4dcb-bb2c-6ea5e4744ef5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:09.793449 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a8382bf2-2653-4dcb-bb2c-6ea5e4744ef5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:09.793870 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a8382bf2-2653-4dcb-bb2c-6ea5e4744ef5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:09.927249 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a8382bf2-2653-4dcb-bb2c-6ea5e4744ef5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:09.935308 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a8382bf2-2653-4dcb-bb2c-6ea5e4744ef5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1723 microversion: 2.1 time: 0.155006 Aug 31 11:50:09.935853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 429/858] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:09 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:09.996299 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-39500d7c-ffb2-48ea-970e-3e176060da5f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:09.997098 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-39500d7c-ffb2-48ea-970e-3e176060da5f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:10.003913 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-39500d7c-ffb2-48ea-970e-3e176060da5f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:10.004385 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-39500d7c-ffb2-48ea-970e-3e176060da5f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:10.004992 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-39500d7c-ffb2-48ea-970e-3e176060da5f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:10.005665 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-39500d7c-ffb2-48ea-970e-3e176060da5f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:10.006119 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-39500d7c-ffb2-48ea-970e-3e176060da5f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:10.006520 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-39500d7c-ffb2-48ea-970e-3e176060da5f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:10.138184 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-39500d7c-ffb2-48ea-970e-3e176060da5f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:10.146553 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-39500d7c-ffb2-48ea-970e-3e176060da5f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1681 microversion: 2.1 time: 0.155026 Aug 31 11:50:10.147102 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 430/859] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:09 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:10.957912 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ca1fbf43-9ee3-4569-af53-e5316fca44c2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:10.958519 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ca1fbf43-9ee3-4569-af53-e5316fca44c2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:10.966003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca1fbf43-9ee3-4569-af53-e5316fca44c2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:10.966719 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca1fbf43-9ee3-4569-af53-e5316fca44c2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:10.967334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca1fbf43-9ee3-4569-af53-e5316fca44c2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:10.968041 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca1fbf43-9ee3-4569-af53-e5316fca44c2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:10.968530 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca1fbf43-9ee3-4569-af53-e5316fca44c2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:10.968938 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca1fbf43-9ee3-4569-af53-e5316fca44c2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:11.167313 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-945a2ee5-ee12-47c9-a6d2-86d3d1c95fad tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:11.167936 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-945a2ee5-ee12-47c9-a6d2-86d3d1c95fad tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:11.175499 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-945a2ee5-ee12-47c9-a6d2-86d3d1c95fad tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:11.175982 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-945a2ee5-ee12-47c9-a6d2-86d3d1c95fad tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:11.176414 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-945a2ee5-ee12-47c9-a6d2-86d3d1c95fad tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:11.177136 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-945a2ee5-ee12-47c9-a6d2-86d3d1c95fad tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:11.177586 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-945a2ee5-ee12-47c9-a6d2-86d3d1c95fad tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:11.178718 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-945a2ee5-ee12-47c9-a6d2-86d3d1c95fad tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:11.241768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ca1fbf43-9ee3-4569-af53-e5316fca44c2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:11.250370 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ca1fbf43-9ee3-4569-af53-e5316fca44c2 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1723 microversion: 2.1 time: 0.296509 Aug 31 11:50:11.252360 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 430/860] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:10 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:11.378163 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-945a2ee5-ee12-47c9-a6d2-86d3d1c95fad tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:11.388931 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-945a2ee5-ee12-47c9-a6d2-86d3d1c95fad tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1681 microversion: 2.1 time: 0.225383 Aug 31 11:50:11.390003 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 431/861] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:11 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1681 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:50:11.925304 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-592f418f-5da7-4954-be3c-5e020b2469d4 req-875aef9a-6e8c-4f78-aabb-3d5783c31726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89973a85-9500-443c-b017-ceeb73cfc3be", "name": "network-vif-deleted", "tag": "297bf55c-ede0-4ca0-8f41-ab94a1b08c26"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:11.934518 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-592f418f-5da7-4954-be3c-5e020b2469d4 req-875aef9a-6e8c-4f78-aabb-3d5783c31726 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:11.934983 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-592f418f-5da7-4954-be3c-5e020b2469d4 req-875aef9a-6e8c-4f78-aabb-3d5783c31726 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:11.935406 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-592f418f-5da7-4954-be3c-5e020b2469d4 req-875aef9a-6e8c-4f78-aabb-3d5783c31726 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:11.946605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-592f418f-5da7-4954-be3c-5e020b2469d4 req-875aef9a-6e8c-4f78-aabb-3d5783c31726 service nova] Creating event network-vif-deleted:297bf55c-ede0-4ca0-8f41-ab94a1b08c26 for instance 89973a85-9500-443c-b017-ceeb73cfc3be on hv-cinder-83976 Aug 31 11:50:11.951579 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-592f418f-5da7-4954-be3c-5e020b2469d4 req-875aef9a-6e8c-4f78-aabb-3d5783c31726 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093301 Aug 31 11:50:11.952164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 431/862] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:50:12.273442 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6d14dc40-08c2-4048-a862-75f0dbacb9ba tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:12.274638 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6d14dc40-08c2-4048-a862-75f0dbacb9ba tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:12.281009 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d14dc40-08c2-4048-a862-75f0dbacb9ba tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:12.281716 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d14dc40-08c2-4048-a862-75f0dbacb9ba tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:12.282388 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d14dc40-08c2-4048-a862-75f0dbacb9ba tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:12.283163 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d14dc40-08c2-4048-a862-75f0dbacb9ba tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:12.283611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d14dc40-08c2-4048-a862-75f0dbacb9ba tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:12.284209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6d14dc40-08c2-4048-a862-75f0dbacb9ba tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:12.413265 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-101a70f6-428d-4033-abac-b4028e953c0a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:12.413989 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-101a70f6-428d-4033-abac-b4028e953c0a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:12.420038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6d14dc40-08c2-4048-a862-75f0dbacb9ba tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:12.421384 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-101a70f6-428d-4033-abac-b4028e953c0a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:12.422408 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-101a70f6-428d-4033-abac-b4028e953c0a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:12.423484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-101a70f6-428d-4033-abac-b4028e953c0a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:12.424723 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-101a70f6-428d-4033-abac-b4028e953c0a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:12.425365 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-101a70f6-428d-4033-abac-b4028e953c0a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:12.426156 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-101a70f6-428d-4033-abac-b4028e953c0a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:12.431866 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6d14dc40-08c2-4048-a862-75f0dbacb9ba tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1723 microversion: 2.1 time: 0.160969 Aug 31 11:50:12.431866 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 432/863] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:12 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:12.493392 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-101a70f6-428d-4033-abac-b4028e953c0a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:12.501332 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-101a70f6-428d-4033-abac-b4028e953c0a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1613 microversion: 2.1 time: 0.094470 Aug 31 11:50:12.501895 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 432/864] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:12 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1613 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:50:13.452637 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-69792270-a69e-44b7-aad2-0b41e71efe94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:13.453231 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-69792270-a69e-44b7-aad2-0b41e71efe94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:13.460150 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-69792270-a69e-44b7-aad2-0b41e71efe94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:13.460665 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-69792270-a69e-44b7-aad2-0b41e71efe94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:13.461108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-69792270-a69e-44b7-aad2-0b41e71efe94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:13.462029 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-69792270-a69e-44b7-aad2-0b41e71efe94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:13.462479 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-69792270-a69e-44b7-aad2-0b41e71efe94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:13.462904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-69792270-a69e-44b7-aad2-0b41e71efe94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:13.524143 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a5494323-f98f-46fc-b5ed-058e15c6d1ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:13.525362 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a5494323-f98f-46fc-b5ed-058e15c6d1ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:13.532340 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a5494323-f98f-46fc-b5ed-058e15c6d1ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:13.532860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a5494323-f98f-46fc-b5ed-058e15c6d1ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:13.533296 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a5494323-f98f-46fc-b5ed-058e15c6d1ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:13.533984 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a5494323-f98f-46fc-b5ed-058e15c6d1ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:13.534432 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a5494323-f98f-46fc-b5ed-058e15c6d1ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:13.535276 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a5494323-f98f-46fc-b5ed-058e15c6d1ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:13.605455 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a5494323-f98f-46fc-b5ed-058e15c6d1ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:13.618736 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-69792270-a69e-44b7-aad2-0b41e71efe94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:13.623376 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a5494323-f98f-46fc-b5ed-058e15c6d1ae tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1613 microversion: 2.1 time: 0.104059 Aug 31 11:50:13.629506 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-69792270-a69e-44b7-aad2-0b41e71efe94 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1723 microversion: 2.1 time: 0.180731 Aug 31 11:50:13.630756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 433/865] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:13 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1613 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:50:13.631925 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 433/866] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:13 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:13.980910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-081bedcd-1e0e-4a2a-8666-def461e3973e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:13.981411 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-081bedcd-1e0e-4a2a-8666-def461e3973e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:13.987537 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-081bedcd-1e0e-4a2a-8666-def461e3973e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:13.988019 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-081bedcd-1e0e-4a2a-8666-def461e3973e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:13.988458 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-081bedcd-1e0e-4a2a-8666-def461e3973e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:13.989154 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-081bedcd-1e0e-4a2a-8666-def461e3973e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:13.989606 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-081bedcd-1e0e-4a2a-8666-def461e3973e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:13.990029 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-081bedcd-1e0e-4a2a-8666-def461e3973e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:14.021301 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-081bedcd-1e0e-4a2a-8666-def461e3973e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/os-volume_attachments/dac3ef0b-3279-452e-85ac-ea529a2bd6d1" status: 200 len: 194 microversion: 2.20 time: 0.044404 Aug 31 11:50:14.021910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 434/867] 10.222.0.60 () {60 vars in 1454 bytes} [Wed Aug 31 11:50:13 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/os-volume_attachments/dac3ef0b-3279-452e-85ac-ea529a2bd6d1 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:50:14.089277 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9150e074-b6a2-464e-a9a5-4dc174b75d0e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:14.089764 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9150e074-b6a2-464e-a9a5-4dc174b75d0e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:14.095974 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9150e074-b6a2-464e-a9a5-4dc174b75d0e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:14.096467 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9150e074-b6a2-464e-a9a5-4dc174b75d0e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:14.096995 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9150e074-b6a2-464e-a9a5-4dc174b75d0e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:14.097683 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9150e074-b6a2-464e-a9a5-4dc174b75d0e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:14.098129 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9150e074-b6a2-464e-a9a5-4dc174b75d0e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:14.098550 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9150e074-b6a2-464e-a9a5-4dc174b75d0e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:14.178358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.objects.instance [None req-9150e074-b6a2-464e-a9a5-4dc174b75d0e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lazy-loading 'services' on Instance uuid 06215e54-27bb-4685-9a34-14109d73c81e {{(pid=127062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:50:14.253261 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9150e074-b6a2-464e-a9a5-4dc174b75d0e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "DELETE /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/os-volume_attachments/dac3ef0b-3279-452e-85ac-ea529a2bd6d1" status: 202 len: 0 microversion: 2.20 time: 0.167782 Aug 31 11:50:14.253968 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 434/868] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Aug 31 11:50:14 2022] DELETE /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/os-volume_attachments/dac3ef0b-3279-452e-85ac-ea529a2bd6d1 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:50:14.262319 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-32db6131-f184-431d-bebf-315314268b61 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:14.264584 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-32db6131-f184-431d-bebf-315314268b61 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:14.270684 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-32db6131-f184-431d-bebf-315314268b61 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:14.271110 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-32db6131-f184-431d-bebf-315314268b61 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:14.271542 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-32db6131-f184-431d-bebf-315314268b61 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:14.272220 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-32db6131-f184-431d-bebf-315314268b61 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:14.272707 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-32db6131-f184-431d-bebf-315314268b61 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:14.273128 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-32db6131-f184-431d-bebf-315314268b61 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:14.302341 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-32db6131-f184-431d-bebf-315314268b61 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043941 Aug 31 11:50:14.302880 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 435/869] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Aug 31 11:50:14 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:50:14.652386 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b1d15cda-0b2e-46fd-b5c0-0bd70a1f5d18 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:14.652994 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b1d15cda-0b2e-46fd-b5c0-0bd70a1f5d18 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:14.653105 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4d58f41d-4ee5-4470-a289-7cc3606a2f69 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:14.653614 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4d58f41d-4ee5-4470-a289-7cc3606a2f69 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:14.660024 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b1d15cda-0b2e-46fd-b5c0-0bd70a1f5d18 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:14.660484 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b1d15cda-0b2e-46fd-b5c0-0bd70a1f5d18 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:14.660935 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b1d15cda-0b2e-46fd-b5c0-0bd70a1f5d18 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:14.661049 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d58f41d-4ee5-4470-a289-7cc3606a2f69 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:14.661415 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d58f41d-4ee5-4470-a289-7cc3606a2f69 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:14.661611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b1d15cda-0b2e-46fd-b5c0-0bd70a1f5d18 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:14.661849 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d58f41d-4ee5-4470-a289-7cc3606a2f69 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:14.662051 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b1d15cda-0b2e-46fd-b5c0-0bd70a1f5d18 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:14.662465 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b1d15cda-0b2e-46fd-b5c0-0bd70a1f5d18 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:14.662564 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d58f41d-4ee5-4470-a289-7cc3606a2f69 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:14.662975 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d58f41d-4ee5-4470-a289-7cc3606a2f69 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:14.663402 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4d58f41d-4ee5-4470-a289-7cc3606a2f69 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:14.700943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b1d15cda-0b2e-46fd-b5c0-0bd70a1f5d18 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:14.701423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b1d15cda-0b2e-46fd-b5c0-0bd70a1f5d18 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:14.701856 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b1d15cda-0b2e-46fd-b5c0-0bd70a1f5d18 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:14.702303 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.objects.instance [None req-b1d15cda-0b2e-46fd-b5c0-0bd70a1f5d18 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lazy-loading 'fault' on Instance uuid 89973a85-9500-443c-b017-ceeb73cfc3be {{(pid=127062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:50:14.747232 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b1d15cda-0b2e-46fd-b5c0-0bd70a1f5d18 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:14.755851 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b1d15cda-0b2e-46fd-b5c0-0bd70a1f5d18 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 200 len: 1331 microversion: 2.1 time: 0.108233 Aug 31 11:50:14.756424 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 435/870] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:14 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:14.800019 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4d58f41d-4ee5-4470-a289-7cc3606a2f69 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:14.808262 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4d58f41d-4ee5-4470-a289-7cc3606a2f69 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1729 microversion: 2.1 time: 0.158975 Aug 31 11:50:14.808857 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 436/871] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:14 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:50:14.829867 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5a7a17f2-31b0-4cd2-951d-46f69ead16b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:14.830358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5a7a17f2-31b0-4cd2-951d-46f69ead16b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:14.836385 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a7a17f2-31b0-4cd2-951d-46f69ead16b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:14.836889 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a7a17f2-31b0-4cd2-951d-46f69ead16b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:14.837312 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a7a17f2-31b0-4cd2-951d-46f69ead16b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:14.837990 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a7a17f2-31b0-4cd2-951d-46f69ead16b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:14.838464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a7a17f2-31b0-4cd2-951d-46f69ead16b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:14.838879 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a7a17f2-31b0-4cd2-951d-46f69ead16b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:14.915996 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5a7a17f2-31b0-4cd2-951d-46f69ead16b0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089482 Aug 31 11:50:14.916634 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 436/872] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 31 11:50:14 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:50:15.314458 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-eea50521-cdee-4ca7-a77b-a461aaff845c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:15.317369 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-eea50521-cdee-4ca7-a77b-a461aaff845c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:15.323751 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eea50521-cdee-4ca7-a77b-a461aaff845c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:15.324316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eea50521-cdee-4ca7-a77b-a461aaff845c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:15.324882 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eea50521-cdee-4ca7-a77b-a461aaff845c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:15.325643 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eea50521-cdee-4ca7-a77b-a461aaff845c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:15.326183 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eea50521-cdee-4ca7-a77b-a461aaff845c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:15.326677 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eea50521-cdee-4ca7-a77b-a461aaff845c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:15.361055 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-eea50521-cdee-4ca7-a77b-a461aaff845c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049450 Aug 31 11:50:15.362064 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 437/873] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Aug 31 11:50:15 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:50:15.778774 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-166414df-a666-42a2-822c-47bae18c605b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:15.779474 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-166414df-a666-42a2-822c-47bae18c605b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:15.785756 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-166414df-a666-42a2-822c-47bae18c605b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:15.786240 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-166414df-a666-42a2-822c-47bae18c605b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:15.786672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-166414df-a666-42a2-822c-47bae18c605b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:15.787361 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-166414df-a666-42a2-822c-47bae18c605b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:15.787811 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-166414df-a666-42a2-822c-47bae18c605b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:15.788232 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-166414df-a666-42a2-822c-47bae18c605b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:15.802509 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-166414df-a666-42a2-822c-47bae18c605b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] HTTP exception thrown: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-166414df-a666-42a2-822c-47bae18c605b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Request method failure captured: Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be HTTP/1.1 Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lNZK36WRJOqsZNJl20dtBROIhvCChjxxXw9hostbElDCeoQYmhRnMS-kPydTDnhED92nvTRK2Z-mbhSicQnNG72V_XHtUyBJEP0Dy5LBQs28qt-qUXpO9451h3L1SwnxBkofz4240mv6LO2saJFZwry8omihvYKRxBlQ5VwAkEiuA Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:50:15.804560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:50:15.806233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4ac4dc41f7e420d811483990e020f22", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}] Aug 31 11:50:15.806233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:50:15.806233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:50:15.806233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:50:15.806233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:50:15.806233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:50:15.806233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:50:15.806233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 5de832888ffd4a69ae88cac6b632304e Aug 31 11:50:15.806233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:50:15.806233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:50:15.806233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. Aug 31 11:50:15.806233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': '89973a85-9500-443c-b017-ceeb73cfc3be'} Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:50:15.807137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. Aug 31 11:50:15.809235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:50:15.810585 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-166414df-a666-42a2-822c-47bae18c605b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Returning 404 to user: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:50:15.810585 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-166414df-a666-42a2-822c-47bae18c605b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 404 len: 111 microversion: 2.1 time: 0.031906 Aug 31 11:50:15.810585 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 437/874] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:15 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:50:15.815923 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-686e0095-167e-4877-bee5-b140e0e715f1 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '.version_select at 0x7f1738133700>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:15.850162 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-686e0095-167e-4877-bee5-b140e0e715f1 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-118047113" status: 202 len: 0 microversion: 2.1 time: 0.038687 Aug 31 11:50:15.851009 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 438/875] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Aug 31 11:50:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-118047113 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:50:15.874491 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-57901ba5-406f-413a-ac13-8533fe577034 req-f99617dd-c223-4da4-806f-75dbdc733f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a75232d-2df1-41c7-b73d-762fba8bd8e6", "tag": "e4add15e-9a0d-473c-9f93-9c2dbb5dee25"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:15.886297 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-57901ba5-406f-413a-ac13-8533fe577034 req-f99617dd-c223-4da4-806f-75dbdc733f56 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:15.887115 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-57901ba5-406f-413a-ac13-8533fe577034 req-f99617dd-c223-4da4-806f-75dbdc733f56 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:15.887742 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-57901ba5-406f-413a-ac13-8533fe577034 req-f99617dd-c223-4da4-806f-75dbdc733f56 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:15.907362 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-57901ba5-406f-413a-ac13-8533fe577034 req-f99617dd-c223-4da4-806f-75dbdc733f56 service nova] Creating event network-changed:e4add15e-9a0d-473c-9f93-9c2dbb5dee25 for instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 on hv-cinder-83976 Aug 31 11:50:15.913002 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-57901ba5-406f-413a-ac13-8533fe577034 req-f99617dd-c223-4da4-806f-75dbdc733f56 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043470 Aug 31 11:50:15.913810 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 438/876] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:50:16.379099 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2710847f-0094-4915-a37e-4b05707208ca tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:16.383468 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2710847f-0094-4915-a37e-4b05707208ca tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:16.392341 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:50:16.394581 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2710847f-0094-4915-a37e-4b05707208ca tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:16.395134 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2710847f-0094-4915-a37e-4b05707208ca tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:16.395567 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2710847f-0094-4915-a37e-4b05707208ca tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:16.396283 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2710847f-0094-4915-a37e-4b05707208ca tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:16.396772 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2710847f-0094-4915-a37e-4b05707208ca tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:16.398006 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2710847f-0094-4915-a37e-4b05707208ca tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:16.435156 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2710847f-0094-4915-a37e-4b05707208ca tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060314 Aug 31 11:50:16.440978 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 439/877] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Aug 31 11:50:16 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:16.510228 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d2b31aa5-9d13-49c4-9ad4-c364dbb7f9c5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:16.510806 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d2b31aa5-9d13-49c4-9ad4-c364dbb7f9c5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:16.517955 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d2b31aa5-9d13-49c4-9ad4-c364dbb7f9c5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:16.518433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d2b31aa5-9d13-49c4-9ad4-c364dbb7f9c5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:16.518853 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d2b31aa5-9d13-49c4-9ad4-c364dbb7f9c5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:16.519576 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d2b31aa5-9d13-49c4-9ad4-c364dbb7f9c5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:16.520012 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d2b31aa5-9d13-49c4-9ad4-c364dbb7f9c5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:16.520430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d2b31aa5-9d13-49c4-9ad4-c364dbb7f9c5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:16.548746 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d2b31aa5-9d13-49c4-9ad4-c364dbb7f9c5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Going to try to terminate instance {{(pid=127062) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:50:16.686807 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d2b31aa5-9d13-49c4-9ad4-c364dbb7f9c5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "DELETE /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 204 len: 0 microversion: 2.20 time: 0.180636 Aug 31 11:50:16.691896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 439/878] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Aug 31 11:50:16 2022] DELETE /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 11:50:16.697358 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bc8ac760-9f8e-473c-b7b2-011aad478f45 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:16.698218 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-bc8ac760-9f8e-473c-b7b2-011aad478f45 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:16.704874 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc8ac760-9f8e-473c-b7b2-011aad478f45 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:16.705498 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc8ac760-9f8e-473c-b7b2-011aad478f45 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:16.706029 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc8ac760-9f8e-473c-b7b2-011aad478f45 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:16.706851 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc8ac760-9f8e-473c-b7b2-011aad478f45 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:16.707430 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc8ac760-9f8e-473c-b7b2-011aad478f45 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:16.708079 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc8ac760-9f8e-473c-b7b2-011aad478f45 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:16.958330 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8502dbbf-0538-441b-878f-744225e450e0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:16.959020 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8502dbbf-0538-441b-878f-744225e450e0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:16.965708 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8502dbbf-0538-441b-878f-744225e450e0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:16.966278 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8502dbbf-0538-441b-878f-744225e450e0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:16.966770 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8502dbbf-0538-441b-878f-744225e450e0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:16.967557 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8502dbbf-0538-441b-878f-744225e450e0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:16.968068 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8502dbbf-0538-441b-878f-744225e450e0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:16.968589 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8502dbbf-0538-441b-878f-744225e450e0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:16.974750 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-bc8ac760-9f8e-473c-b7b2-011aad478f45 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:16.983570 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-bc8ac760-9f8e-473c-b7b2-011aad478f45 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:16.985431 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-bc8ac760-9f8e-473c-b7b2-011aad478f45 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:16.986804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-bc8ac760-9f8e-473c-b7b2-011aad478f45 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.293689 Aug 31 11:50:16.987366 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 440/879] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:16 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:50:17.060166 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.objects.instance [None req-8502dbbf-0538-441b-878f-744225e450e0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lazy-loading 'services' on Instance uuid ece59cd5-8579-4406-be68-9d0204aeb446 {{(pid=127062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:50:17.136312 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8502dbbf-0538-441b-878f-744225e450e0 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446/os-volume_attachments/9ba03f5f-7e61-49f0-a1e0-80cafa355d18" status: 202 len: 0 microversion: 2.1 time: 0.182271 Aug 31 11:50:17.137160 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 440/880] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 31 11:50:16 2022] DELETE /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446/os-volume_attachments/9ba03f5f-7e61-49f0-a1e0-80cafa355d18 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:50:17.146427 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1f3fcd40-6f74-4b8d-823e-3372827796dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:17.148671 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1f3fcd40-6f74-4b8d-823e-3372827796dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:17.154556 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1f3fcd40-6f74-4b8d-823e-3372827796dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:17.155031 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1f3fcd40-6f74-4b8d-823e-3372827796dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:17.155466 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1f3fcd40-6f74-4b8d-823e-3372827796dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:17.156332 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1f3fcd40-6f74-4b8d-823e-3372827796dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:17.156889 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1f3fcd40-6f74-4b8d-823e-3372827796dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:17.157458 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1f3fcd40-6f74-4b8d-823e-3372827796dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:17.186512 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1f3fcd40-6f74-4b8d-823e-3372827796dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044076 Aug 31 11:50:17.187053 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 441/881] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:50:17 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:50:17.927569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-cff7a575-090c-45c0-8b13-c501e687d6a1 req-cd0fe5ea-05eb-4437-85df-01de96d83e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a75232d-2df1-41c7-b73d-762fba8bd8e6", "tag": "e4add15e-9a0d-473c-9f93-9c2dbb5dee25"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:17.937161 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-cff7a575-090c-45c0-8b13-c501e687d6a1 req-cd0fe5ea-05eb-4437-85df-01de96d83e43 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:17.937572 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-cff7a575-090c-45c0-8b13-c501e687d6a1 req-cd0fe5ea-05eb-4437-85df-01de96d83e43 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:17.938400 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-cff7a575-090c-45c0-8b13-c501e687d6a1 req-cd0fe5ea-05eb-4437-85df-01de96d83e43 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:17.950866 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-cff7a575-090c-45c0-8b13-c501e687d6a1 req-cd0fe5ea-05eb-4437-85df-01de96d83e43 service nova] Creating event network-changed:e4add15e-9a0d-473c-9f93-9c2dbb5dee25 for instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 on hv-cinder-83976 Aug 31 11:50:17.956654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-cff7a575-090c-45c0-8b13-c501e687d6a1 req-cd0fe5ea-05eb-4437-85df-01de96d83e43 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033225 Aug 31 11:50:17.957247 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 441/882] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:50:18.010835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ff2c212f-5b95-4af6-b9b5-4b3f6bc863b0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:18.011438 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ff2c212f-5b95-4af6-b9b5-4b3f6bc863b0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:18.018406 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ff2c212f-5b95-4af6-b9b5-4b3f6bc863b0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:18.018912 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ff2c212f-5b95-4af6-b9b5-4b3f6bc863b0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:18.019351 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ff2c212f-5b95-4af6-b9b5-4b3f6bc863b0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:18.020060 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ff2c212f-5b95-4af6-b9b5-4b3f6bc863b0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:18.020525 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ff2c212f-5b95-4af6-b9b5-4b3f6bc863b0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:18.020954 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ff2c212f-5b95-4af6-b9b5-4b3f6bc863b0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:18.148019 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ff2c212f-5b95-4af6-b9b5-4b3f6bc863b0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:18.163929 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ff2c212f-5b95-4af6-b9b5-4b3f6bc863b0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:18.165389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ff2c212f-5b95-4af6-b9b5-4b3f6bc863b0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:18.166588 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ff2c212f-5b95-4af6-b9b5-4b3f6bc863b0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.159660 Aug 31 11:50:18.167315 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 442/883] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:18 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:50:18.200619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e8b625e9-1f28-4099-b957-da13361858ee tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:18.202989 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e8b625e9-1f28-4099-b957-da13361858ee tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:18.211219 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e8b625e9-1f28-4099-b957-da13361858ee tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:18.211706 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e8b625e9-1f28-4099-b957-da13361858ee tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:18.212133 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e8b625e9-1f28-4099-b957-da13361858ee tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:18.212847 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e8b625e9-1f28-4099-b957-da13361858ee tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:18.213288 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e8b625e9-1f28-4099-b957-da13361858ee tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:18.213707 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e8b625e9-1f28-4099-b957-da13361858ee tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:18.247161 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e8b625e9-1f28-4099-b957-da13361858ee tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051136 Aug 31 11:50:18.247725 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 442/884] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:50:18 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:50:19.193170 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8c047fa8-c559-4ccb-a155-d437dc9f3b16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:19.194405 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8c047fa8-c559-4ccb-a155-d437dc9f3b16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:19.200266 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c047fa8-c559-4ccb-a155-d437dc9f3b16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:19.200785 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c047fa8-c559-4ccb-a155-d437dc9f3b16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:19.201217 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c047fa8-c559-4ccb-a155-d437dc9f3b16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:19.201912 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c047fa8-c559-4ccb-a155-d437dc9f3b16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:19.202359 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c047fa8-c559-4ccb-a155-d437dc9f3b16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:19.202808 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8c047fa8-c559-4ccb-a155-d437dc9f3b16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:19.261613 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cc7736d4-51bb-4e62-bb39-f6cbf9715ea8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:19.262980 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cc7736d4-51bb-4e62-bb39-f6cbf9715ea8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:19.270224 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc7736d4-51bb-4e62-bb39-f6cbf9715ea8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:19.270966 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc7736d4-51bb-4e62-bb39-f6cbf9715ea8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:19.271597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc7736d4-51bb-4e62-bb39-f6cbf9715ea8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:19.272513 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc7736d4-51bb-4e62-bb39-f6cbf9715ea8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:19.273123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc7736d4-51bb-4e62-bb39-f6cbf9715ea8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:19.274580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc7736d4-51bb-4e62-bb39-f6cbf9715ea8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:19.311163 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cc7736d4-51bb-4e62-bb39-f6cbf9715ea8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055510 Aug 31 11:50:19.312423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 443/885] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:50:19 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 11:50:19.364398 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8c047fa8-c559-4ccb-a155-d437dc9f3b16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:19.373302 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8c047fa8-c559-4ccb-a155-d437dc9f3b16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:19.374741 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8c047fa8-c559-4ccb-a155-d437dc9f3b16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:19.376584 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8c047fa8-c559-4ccb-a155-d437dc9f3b16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1725 microversion: 2.20 time: 0.188829 Aug 31 11:50:19.377129 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 443/886] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:19 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:50:19.390593 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-865fc721-e447-4f64-b031-cb94f3941c88 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:19.391688 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-865fc721-e447-4f64-b031-cb94f3941c88 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:19.397885 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-865fc721-e447-4f64-b031-cb94f3941c88 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:19.398358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-865fc721-e447-4f64-b031-cb94f3941c88 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:19.398783 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-865fc721-e447-4f64-b031-cb94f3941c88 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:19.399458 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-865fc721-e447-4f64-b031-cb94f3941c88 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:19.399898 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-865fc721-e447-4f64-b031-cb94f3941c88 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:19.400311 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-865fc721-e447-4f64-b031-cb94f3941c88 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:19.404290 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:50:19.429554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-865fc721-e447-4f64-b031-cb94f3941c88 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Going to try to terminate instance {{(pid=127062) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:50:19.512310 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-865fc721-e447-4f64-b031-cb94f3941c88 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 204 len: 0 microversion: 2.1 time: 0.125108 Aug 31 11:50:19.512862 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 444/887] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:50:19 2022] DELETE /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:50:19.521912 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ce36fe3e-2409-47fb-9064-e5044f6b11bf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:19.523353 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ce36fe3e-2409-47fb-9064-e5044f6b11bf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:19.529599 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ce36fe3e-2409-47fb-9064-e5044f6b11bf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:19.530163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ce36fe3e-2409-47fb-9064-e5044f6b11bf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:19.530660 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ce36fe3e-2409-47fb-9064-e5044f6b11bf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:19.531437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ce36fe3e-2409-47fb-9064-e5044f6b11bf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:19.533096 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ce36fe3e-2409-47fb-9064-e5044f6b11bf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:19.533725 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ce36fe3e-2409-47fb-9064-e5044f6b11bf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:19.671297 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ce36fe3e-2409-47fb-9064-e5044f6b11bf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:19.681027 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ce36fe3e-2409-47fb-9064-e5044f6b11bf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1679 microversion: 2.1 time: 0.162466 Aug 31 11:50:19.681415 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 444/888] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:19 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:19.972509 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-02ef8d89-fee3-4a0e-989a-9d3995d36638 req-ab68586a-9a38-4fb6-a58e-8c70c0811cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06215e54-27bb-4685-9a34-14109d73c81e", "name": "network-vif-deleted", "tag": "c4e2bf04-c687-4686-9210-e0be89d06923"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:19.982810 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-02ef8d89-fee3-4a0e-989a-9d3995d36638 req-ab68586a-9a38-4fb6-a58e-8c70c0811cac service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:19.983624 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-02ef8d89-fee3-4a0e-989a-9d3995d36638 req-ab68586a-9a38-4fb6-a58e-8c70c0811cac service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:19.984256 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-02ef8d89-fee3-4a0e-989a-9d3995d36638 req-ab68586a-9a38-4fb6-a58e-8c70c0811cac service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:19.997978 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-02ef8d89-fee3-4a0e-989a-9d3995d36638 req-ab68586a-9a38-4fb6-a58e-8c70c0811cac service nova] Creating event network-vif-deleted:c4e2bf04-c687-4686-9210-e0be89d06923 for instance 06215e54-27bb-4685-9a34-14109d73c81e on hv-cinder-83976 Aug 31 11:50:20.004528 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-02ef8d89-fee3-4a0e-989a-9d3995d36638 req-ab68586a-9a38-4fb6-a58e-8c70c0811cac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036838 Aug 31 11:50:20.005671 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 445/889] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:50:20.399283 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:20.400014 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:20.406337 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:20.407139 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:20.407577 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:20.408278 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:20.408752 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:20.409182 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:20.443117 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:20.443603 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:20.444040 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:20.444484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lazy-loading 'fault' on Instance uuid 06215e54-27bb-4685-9a34-14109d73c81e {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:50:20.447270 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:50:20.486450 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:20.494699 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:20.496175 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:20.497347 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ab58a697-cc39-447e-b5ba-4ad9e9034de2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 200 len: 1372 microversion: 2.20 time: 0.102020 Aug 31 11:50:20.497913 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 445/890] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:20 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:50:20.702585 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-13d7c3f1-6a1c-4245-8cf8-0b01fafd8190 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:20.703279 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-13d7c3f1-6a1c-4245-8cf8-0b01fafd8190 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:20.710276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-13d7c3f1-6a1c-4245-8cf8-0b01fafd8190 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:20.710759 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-13d7c3f1-6a1c-4245-8cf8-0b01fafd8190 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:20.711403 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-13d7c3f1-6a1c-4245-8cf8-0b01fafd8190 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:20.712090 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-13d7c3f1-6a1c-4245-8cf8-0b01fafd8190 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:20.712560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-13d7c3f1-6a1c-4245-8cf8-0b01fafd8190 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:20.712981 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-13d7c3f1-6a1c-4245-8cf8-0b01fafd8190 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:20.949727 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-13d7c3f1-6a1c-4245-8cf8-0b01fafd8190 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:20.957413 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-13d7c3f1-6a1c-4245-8cf8-0b01fafd8190 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1679 microversion: 2.1 time: 0.259699 Aug 31 11:50:20.957983 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 446/891] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:20 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1679 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:21.521200 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5e47a681-f8b7-4a21-955d-a669043892ee tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:21.521820 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5e47a681-f8b7-4a21-955d-a669043892ee tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:21.528133 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5e47a681-f8b7-4a21-955d-a669043892ee tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:21.528642 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5e47a681-f8b7-4a21-955d-a669043892ee tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:21.529069 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5e47a681-f8b7-4a21-955d-a669043892ee tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:21.529755 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5e47a681-f8b7-4a21-955d-a669043892ee tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:21.530205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5e47a681-f8b7-4a21-955d-a669043892ee tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:21.530624 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5e47a681-f8b7-4a21-955d-a669043892ee tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:21.701109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-5e47a681-f8b7-4a21-955d-a669043892ee tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] HTTP exception thrown: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5e47a681-f8b7-4a21-955d-a669043892ee tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Request method failure captured: Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e HTTP/1.1 Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lJpcTrn2pLuUpyWlfyBmJ8Vt5JJ3uQ9jN10mg0OVovMDnoYwXIZjXocsPXhMukVZty2BNiMkG0ANSlP-GAoSzVorz2e1TgtDzD_qYmy-Suxl3bSzErwIE2aUzE2pM9oyHzJ8M5qSQa0NIp5D2BabPWHbiCz8IFK2W7BE_NlZj6M7o Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: 23acf169856c41d888a1d4c0e61cfee2 Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:50:21.704540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:50:21.706120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_23acf169856c41d888a1d4c0e61cfee2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/23acf169856c41d888a1d4c0e61cfee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23acf169856c41d888a1d4c0e61cfee2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23acf169856c41d888a1d4c0e61cfee2"}]}] Aug 31 11:50:21.706120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:50:21.706120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: 23acf169856c41d888a1d4c0e61cfee2 Aug 31 11:50:21.706120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:50:21.706120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-AttachVolumeShelveTestJSON-910663346-project Aug 31 11:50:21.706120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:50:21.706120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:50:21.706120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: bcd4602a40964a81931cdadc92d7f281 Aug 31 11:50:21.706120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-AttachVolumeShelveTestJSON-910663346-project Aug 31 11:50:21.706120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:50:21.706120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. Aug 31 11:50:21.706120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '06215e54-27bb-4685-9a34-14109d73c81e'} Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:50:21.707075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. Aug 31 11:50:21.708823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:21.714720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5e47a681-f8b7-4a21-955d-a669043892ee tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Returning 404 to user: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:50:21.714720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5e47a681-f8b7-4a21-955d-a669043892ee tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 404 len: 111 microversion: 2.20 time: 0.191969 Aug 31 11:50:21.714720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 446/892] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:21 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 11:50:21.722498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c2cce826-7cd8-412e-bdb3-1e91e2d5ddfa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '.version_select at 0x7f17347615e0>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:21.749521 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c2cce826-7cd8-412e-bdb3-1e91e2d5ddfa tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877806679" status: 204 len: 0 microversion: 2.20 time: 0.032778 Aug 31 11:50:21.750517 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 447/893] 10.222.0.60 () {60 vars in 1262 bytes} [Wed Aug 31 11:50:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877806679 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 11:50:21.979043 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-21a428d6-acce-41e9-b635-2f261801b32d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:21.980250 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-21a428d6-acce-41e9-b635-2f261801b32d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:21.988115 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21a428d6-acce-41e9-b635-2f261801b32d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:21.988648 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21a428d6-acce-41e9-b635-2f261801b32d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:21.989340 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21a428d6-acce-41e9-b635-2f261801b32d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:21.990038 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21a428d6-acce-41e9-b635-2f261801b32d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:21.990485 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21a428d6-acce-41e9-b635-2f261801b32d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:21.990903 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21a428d6-acce-41e9-b635-2f261801b32d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:22.023108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-aa32f2b6-1aa3-43a7-b869-66f1918767bc req-13023e03-ec87-42ae-82ca-ec5655439c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece59cd5-8579-4406-be68-9d0204aeb446", "name": "network-vif-deleted", "tag": "df889158-674c-400a-bd63-cbcff640456f"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:22.039690 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-aa32f2b6-1aa3-43a7-b869-66f1918767bc req-13023e03-ec87-42ae-82ca-ec5655439c0a service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:22.043484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21a428d6-acce-41e9-b635-2f261801b32d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:22.044238 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-aa32f2b6-1aa3-43a7-b869-66f1918767bc req-13023e03-ec87-42ae-82ca-ec5655439c0a service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:22.045038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-aa32f2b6-1aa3-43a7-b869-66f1918767bc req-13023e03-ec87-42ae-82ca-ec5655439c0a service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:22.049311 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21a428d6-acce-41e9-b635-2f261801b32d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:22.050991 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21a428d6-acce-41e9-b635-2f261801b32d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:22.051644 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-21a428d6-acce-41e9-b635-2f261801b32d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lazy-loading 'fault' on Instance uuid ece59cd5-8579-4406-be68-9d0204aeb446 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:50:22.065055 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-aa32f2b6-1aa3-43a7-b869-66f1918767bc req-13023e03-ec87-42ae-82ca-ec5655439c0a service nova] Creating event network-vif-deleted:df889158-674c-400a-bd63-cbcff640456f for instance ece59cd5-8579-4406-be68-9d0204aeb446 on hv-cinder-83976 Aug 31 11:50:22.070423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-aa32f2b6-1aa3-43a7-b869-66f1918767bc req-13023e03-ec87-42ae-82ca-ec5655439c0a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050958 Aug 31 11:50:22.071217 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 448/894] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:50:22.128106 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-21a428d6-acce-41e9-b635-2f261801b32d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:22.135870 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-21a428d6-acce-41e9-b635-2f261801b32d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 200 len: 1330 microversion: 2.1 time: 0.161503 Aug 31 11:50:22.136815 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 447/895] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:21 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 1330 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:22.546423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-24b0a343-9f3c-45d1-b48c-51082f62ab9d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Action: 'create', calling method: .version_select at 0x7f173477ed30>, body: {"keypair": {"name": "tempest-keypair-832228715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsTiJKdZ8sVCjjuDZ25H2IQ6vTRQ2LLMExG17l5nnEnZZV5JRe0K32NGmVMw0mh2MjKmFs/8D7NgDpS/QD2t16jTqgfS9SfzRI7AER+fRzqGghe8qGZeUb6AY2ZhIwlNA=="}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:22.562462 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-24b0a343-9f3c-45d1-b48c-51082f62ab9d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Getting quotas for project 23acf169856c41d888a1d4c0e61cfee2. Resources: {'key_pairs'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:50:22.567593 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-24b0a343-9f3c-45d1-b48c-51082f62ab9d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Getting quotas for user bcd4602a40964a81931cdadc92d7f281 and project 23acf169856c41d888a1d4c0e61cfee2. Resources: {'key_pairs'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:50:22.590693 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-24b0a343-9f3c-45d1-b48c-51082f62ab9d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048588 Aug 31 11:50:22.591427 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 449/896] 10.222.0.60 () {62 vars in 1200 bytes} [Wed Aug 31 11:50:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 11:50:23.157529 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f1581f30-3792-4bd5-b519-98f3f07aa80f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:23.158134 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f1581f30-3792-4bd5-b519-98f3f07aa80f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:23.164747 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f1581f30-3792-4bd5-b519-98f3f07aa80f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:23.165231 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f1581f30-3792-4bd5-b519-98f3f07aa80f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:23.165663 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f1581f30-3792-4bd5-b519-98f3f07aa80f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:23.166358 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f1581f30-3792-4bd5-b519-98f3f07aa80f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:23.166805 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f1581f30-3792-4bd5-b519-98f3f07aa80f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:23.167228 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f1581f30-3792-4bd5-b519-98f3f07aa80f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:23.181266 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-f1581f30-3792-4bd5-b519-98f3f07aa80f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] HTTP exception thrown: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f1581f30-3792-4bd5-b519-98f3f07aa80f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Request method failure captured: Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 HTTP/1.1 Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lNZK36WRJOqsZNJl20dtBROIhvCChjxxXw9hostbElDCeoQYmhRnMS-kPydTDnhED92nvTRK2Z-mbhSicQnNG72V_XHtUyBJEP0Dy5LBQs28qt-qUXpO9451h3L1SwnxBkofz4240mv6LO2saJFZwry8omihvYKRxBlQ5VwAkEiuA Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:50:23.182783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:50:23.184138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4ac4dc41f7e420d811483990e020f22", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}] Aug 31 11:50:23.184138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:50:23.184138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:50:23.184138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:50:23.184138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:50:23.184138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:50:23.184138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:50:23.184138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 5de832888ffd4a69ae88cac6b632304e Aug 31 11:50:23.184138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:50:23.184138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:50:23.184138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. Aug 31 11:50:23.184138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': 'ece59cd5-8579-4406-be68-9d0204aeb446'} Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:50:23.184931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. Aug 31 11:50:23.186132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:50:23.187278 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f1581f30-3792-4bd5-b519-98f3f07aa80f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Returning 404 to user: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:50:23.187278 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f1581f30-3792-4bd5-b519-98f3f07aa80f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 404 len: 111 microversion: 2.1 time: 0.030788 Aug 31 11:50:23.189845 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 448/897] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:23 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:50:23.195091 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2d122efa-cc8b-46f5-84df-0255e20bf059 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '.version_select at 0x7f1734746700>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:23.213773 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2d122efa-cc8b-46f5-84df-0255e20bf059 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-77335979" status: 202 len: 0 microversion: 2.1 time: 0.023429 Aug 31 11:50:23.214529 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 450/898] 10.222.0.60 () {58 vars in 1215 bytes} [Wed Aug 31 11:50:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-77335979 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:50:23.889906 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8fe6b3bc-c827-43ec-809e-d30a1ce7b48d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Action: 'create', calling method: .version_select at 0x7f173808dc10>, body: {"keypair": {"name": "tempest-keypair-629039051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlpLRBRdIHNWhR1ob3fqfPHt5P1RlcyP5Jvcl+AQVa4+IPcNBJrxnSpCWJaMw35tNVW6YbWm5fxios7u0ZUyCYIcOCC05q1M9m5flVCvbRe78cv4cnWy+XF/TKP1Xp05A=="}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:23.892058 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2002977458", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f4395ed-c7d4-48e6-8582-4664b70541e8"}], "security_groups": [{"name": "tempest-securitygroup--1283978365"}], "key_name": "tempest-keypair-832228715", "user_data": "}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:23.905295 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-8fe6b3bc-c827-43ec-809e-d30a1ce7b48d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for project b4ac4dc41f7e420d811483990e020f22. Resources: {'key_pairs'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:50:23.909354 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-8fe6b3bc-c827-43ec-809e-d30a1ce7b48d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for user 5de832888ffd4a69ae88cac6b632304e and project b4ac4dc41f7e420d811483990e020f22. Resources: {'key_pairs'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:50:23.931749 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8fe6b3bc-c827-43ec-809e-d30a1ce7b48d tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045832 Aug 31 11:50:23.932455 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 449/899] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 31 11:50:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:50:24.021471 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.network.neutron [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] validate_networks() for [('0f4395ed-c7d4-48e6-8582-4664b70541e8', None, None, None, None, None)] {{(pid=127062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:50:24.581033 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Flavor limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:50:24.581671 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Image limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:50:24.582093 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Flavor pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:50:24.582495 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Image pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:50:24.582953 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:50:24.592132 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:24.592651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:24.593081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:24.593858 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:24.594310 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:24.594728 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:24.611191 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Getting quotas for project 23acf169856c41d888a1d4c0e61cfee2. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:50:24.615172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Getting quotas for user bcd4602a40964a81931cdadc92d7f281 and project 23acf169856c41d888a1d4c0e61cfee2. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:50:24.627337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Going to run 1 instances... {{(pid=127062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:50:24.629979 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:50:24.679626 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b72e2b53-01d9-46a5-bb42-26fd767bff2c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.792079 Aug 31 11:50:24.680604 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 451/900] 10.222.0.60 () {62 vars in 1188 bytes} [Wed Aug 31 11:50:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 11:50:24.693263 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b5420519-6d3a-41f9-9440-79b0cbab9b43 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:24.694443 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b5420519-6d3a-41f9-9440-79b0cbab9b43 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:24.783961 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b5420519-6d3a-41f9-9440-79b0cbab9b43 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:24.791648 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b5420519-6d3a-41f9-9440-79b0cbab9b43 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:24.793237 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b5420519-6d3a-41f9-9440-79b0cbab9b43 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:24.794418 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b5420519-6d3a-41f9-9440-79b0cbab9b43 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1281 microversion: 2.20 time: 0.107391 Aug 31 11:50:24.795036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 450/901] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:24 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1281 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:50:25.372889 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1420300625", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5aa6b83-6517-47ce-979a-ff78821ec50d"}], "security_groups": [{"name": "tempest-securitygroup--593682179"}], "key_name": "tempest-keypair-629039051", "user_data": "}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:25.494037 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.network.neutron [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] validate_networks() for [('e5aa6b83-6517-47ce-979a-ff78821ec50d', None, None, None, None, None)] {{(pid=127062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:50:25.817137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5d9053ed-2715-43eb-bf54-acd68864d3ae tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:25.817736 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5d9053ed-2715-43eb-bf54-acd68864d3ae tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:25.824763 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5d9053ed-2715-43eb-bf54-acd68864d3ae tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:25.825246 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5d9053ed-2715-43eb-bf54-acd68864d3ae tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:25.825678 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5d9053ed-2715-43eb-bf54-acd68864d3ae tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:25.826367 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5d9053ed-2715-43eb-bf54-acd68864d3ae tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:25.826814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5d9053ed-2715-43eb-bf54-acd68864d3ae tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:25.827257 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5d9053ed-2715-43eb-bf54-acd68864d3ae tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:25.873659 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Flavor limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:50:25.874139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Image limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:50:25.874540 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Flavor pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:50:25.874972 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Image pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:50:25.875964 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:50:25.884685 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:25.885167 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:25.885605 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:25.886334 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:25.886811 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:25.887199 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:25.889421 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5d9053ed-2715-43eb-bf54-acd68864d3ae tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:25.897693 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5d9053ed-2715-43eb-bf54-acd68864d3ae tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:25.899215 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5d9053ed-2715-43eb-bf54-acd68864d3ae tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:25.900390 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5d9053ed-2715-43eb-bf54-acd68864d3ae tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1333 microversion: 2.20 time: 0.087097 Aug 31 11:50:25.901144 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 451/902] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:25 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:50:25.905383 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for project b4ac4dc41f7e420d811483990e020f22. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:50:25.908376 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:50:25.910967 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for user 5de832888ffd4a69ae88cac6b632304e and project b4ac4dc41f7e420d811483990e020f22. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:50:25.925408 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Going to run 1 instances... {{(pid=127062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:50:25.927779 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:50:25.978338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-180f0e83-ce57-408e-8715-066cf72fff79 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.610384 Aug 31 11:50:25.980548 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 452/903] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:50:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:50:25.991972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7e2b9bac-8b23-4899-bc4a-0195976dd7ab tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:25.993073 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7e2b9bac-8b23-4899-bc4a-0195976dd7ab tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:26.046768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7e2b9bac-8b23-4899-bc4a-0195976dd7ab tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:26.055783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7e2b9bac-8b23-4899-bc4a-0195976dd7ab tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1241 microversion: 2.1 time: 0.068207 Aug 31 11:50:26.056799 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 452/904] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:25 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:50:26.924013 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c9eec904-f46a-4c8c-88c7-643da6ea0c16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:26.924842 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c9eec904-f46a-4c8c-88c7-643da6ea0c16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:26.931798 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c9eec904-f46a-4c8c-88c7-643da6ea0c16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:26.932254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c9eec904-f46a-4c8c-88c7-643da6ea0c16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:26.932888 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c9eec904-f46a-4c8c-88c7-643da6ea0c16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:26.933907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c9eec904-f46a-4c8c-88c7-643da6ea0c16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:26.934508 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c9eec904-f46a-4c8c-88c7-643da6ea0c16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:26.934980 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c9eec904-f46a-4c8c-88c7-643da6ea0c16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:27.076333 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-62eaad6d-012e-48bf-868b-96cfc4162b14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:27.076958 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-62eaad6d-012e-48bf-868b-96cfc4162b14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:27.084093 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62eaad6d-012e-48bf-868b-96cfc4162b14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:27.084679 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62eaad6d-012e-48bf-868b-96cfc4162b14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:27.085112 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62eaad6d-012e-48bf-868b-96cfc4162b14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:27.085814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62eaad6d-012e-48bf-868b-96cfc4162b14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:27.086256 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62eaad6d-012e-48bf-868b-96cfc4162b14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:27.086672 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-62eaad6d-012e-48bf-868b-96cfc4162b14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:27.158025 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-62eaad6d-012e-48bf-868b-96cfc4162b14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:27.166003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-62eaad6d-012e-48bf-868b-96cfc4162b14 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1293 microversion: 2.1 time: 0.093400 Aug 31 11:50:27.166582 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 453/905] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:27 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:50:27.514110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c9eec904-f46a-4c8c-88c7-643da6ea0c16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:27.523259 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c9eec904-f46a-4c8c-88c7-643da6ea0c16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:27.524745 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c9eec904-f46a-4c8c-88c7-643da6ea0c16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:27.525851 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c9eec904-f46a-4c8c-88c7-643da6ea0c16 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1407 microversion: 2.20 time: 0.606527 Aug 31 11:50:27.526411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 453/906] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:26 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1407 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:50:27.798800 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-d0414b62-926c-4c7a-8422-c31af1b1cdc9 req-5a0df20a-4dda-47dc-8fac-cbe489bc4dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06aad3ea-8a4f-44c5-829c-b0230807fdf7", "tag": "936e8033-671c-4a3d-9abe-a63045a10877"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:27.809090 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-d0414b62-926c-4c7a-8422-c31af1b1cdc9 req-5a0df20a-4dda-47dc-8fac-cbe489bc4dc2 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:27.810008 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-d0414b62-926c-4c7a-8422-c31af1b1cdc9 req-5a0df20a-4dda-47dc-8fac-cbe489bc4dc2 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:27.810631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-d0414b62-926c-4c7a-8422-c31af1b1cdc9 req-5a0df20a-4dda-47dc-8fac-cbe489bc4dc2 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:27.824858 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-d0414b62-926c-4c7a-8422-c31af1b1cdc9 req-5a0df20a-4dda-47dc-8fac-cbe489bc4dc2 service nova] Creating event network-changed:936e8033-671c-4a3d-9abe-a63045a10877 for instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 on hv-cinder-83976 Aug 31 11:50:27.831643 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-d0414b62-926c-4c7a-8422-c31af1b1cdc9 req-5a0df20a-4dda-47dc-8fac-cbe489bc4dc2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037309 Aug 31 11:50:27.833767 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 454/907] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:50:28.190773 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-485a967a-6af2-44dc-9089-c486fcc52044 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:28.192189 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-485a967a-6af2-44dc-9089-c486fcc52044 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:28.202733 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-485a967a-6af2-44dc-9089-c486fcc52044 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:28.203996 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-485a967a-6af2-44dc-9089-c486fcc52044 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:28.204517 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-485a967a-6af2-44dc-9089-c486fcc52044 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:28.205435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-485a967a-6af2-44dc-9089-c486fcc52044 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:28.205993 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-485a967a-6af2-44dc-9089-c486fcc52044 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:28.206986 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-485a967a-6af2-44dc-9089-c486fcc52044 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:28.401524 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-485a967a-6af2-44dc-9089-c486fcc52044 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:28.410044 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-485a967a-6af2-44dc-9089-c486fcc52044 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1366 microversion: 2.1 time: 0.226200 Aug 31 11:50:28.410755 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 454/908] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:28 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:50:28.551356 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a113bac4-9358-4c28-a7f5-87bf2ba1aee2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:28.552077 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a113bac4-9358-4c28-a7f5-87bf2ba1aee2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:28.558248 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a113bac4-9358-4c28-a7f5-87bf2ba1aee2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:28.558727 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a113bac4-9358-4c28-a7f5-87bf2ba1aee2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:28.559950 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a113bac4-9358-4c28-a7f5-87bf2ba1aee2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:28.561013 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a113bac4-9358-4c28-a7f5-87bf2ba1aee2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:28.561460 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a113bac4-9358-4c28-a7f5-87bf2ba1aee2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:28.561882 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a113bac4-9358-4c28-a7f5-87bf2ba1aee2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:28.777135 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a113bac4-9358-4c28-a7f5-87bf2ba1aee2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:28.785726 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a113bac4-9358-4c28-a7f5-87bf2ba1aee2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:28.787252 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a113bac4-9358-4c28-a7f5-87bf2ba1aee2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:28.788362 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a113bac4-9358-4c28-a7f5-87bf2ba1aee2 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1407 microversion: 2.20 time: 0.242074 Aug 31 11:50:28.788962 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 455/909] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:28 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:50:28.827635 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-97f7c2a3-f2c4-4705-9477-1c734c371f60 req-c8342017-3047-4408-92aa-513408ecb3ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a8e93a-cf62-4e41-98c8-a824827b2fda", "tag": "34bf57b1-b383-42f7-8724-12e4424e5e56"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:28.837836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-97f7c2a3-f2c4-4705-9477-1c734c371f60 req-c8342017-3047-4408-92aa-513408ecb3ea service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:28.838329 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-97f7c2a3-f2c4-4705-9477-1c734c371f60 req-c8342017-3047-4408-92aa-513408ecb3ea service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:28.838739 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-97f7c2a3-f2c4-4705-9477-1c734c371f60 req-c8342017-3047-4408-92aa-513408ecb3ea service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:28.850014 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-97f7c2a3-f2c4-4705-9477-1c734c371f60 req-c8342017-3047-4408-92aa-513408ecb3ea service nova] Creating event network-changed:34bf57b1-b383-42f7-8724-12e4424e5e56 for instance 95a8e93a-cf62-4e41-98c8-a824827b2fda on hv-cinder-83976 Aug 31 11:50:28.854834 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-97f7c2a3-f2c4-4705-9477-1c734c371f60 req-c8342017-3047-4408-92aa-513408ecb3ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030906 Aug 31 11:50:28.855416 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 455/910] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:50:29.430637 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9ad5e62e-f5f2-4856-adca-d23596587245 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:29.431240 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9ad5e62e-f5f2-4856-adca-d23596587245 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:29.437129 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9ad5e62e-f5f2-4856-adca-d23596587245 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:29.438287 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9ad5e62e-f5f2-4856-adca-d23596587245 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:29.439172 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9ad5e62e-f5f2-4856-adca-d23596587245 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:29.439853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9ad5e62e-f5f2-4856-adca-d23596587245 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:29.440300 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9ad5e62e-f5f2-4856-adca-d23596587245 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:29.440748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9ad5e62e-f5f2-4856-adca-d23596587245 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:29.569887 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9ad5e62e-f5f2-4856-adca-d23596587245 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:29.577503 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9ad5e62e-f5f2-4856-adca-d23596587245 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1366 microversion: 2.1 time: 0.150653 Aug 31 11:50:29.578129 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 456/911] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:29 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:29.812383 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c81e4e25-e1ec-44d8-ae4f-6c429b7a1188 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:29.813235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c81e4e25-e1ec-44d8-ae4f-6c429b7a1188 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:29.819354 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c81e4e25-e1ec-44d8-ae4f-6c429b7a1188 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:29.819834 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c81e4e25-e1ec-44d8-ae4f-6c429b7a1188 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:29.820268 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c81e4e25-e1ec-44d8-ae4f-6c429b7a1188 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:29.821020 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c81e4e25-e1ec-44d8-ae4f-6c429b7a1188 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:29.821471 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c81e4e25-e1ec-44d8-ae4f-6c429b7a1188 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:29.821894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c81e4e25-e1ec-44d8-ae4f-6c429b7a1188 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:29.958202 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c81e4e25-e1ec-44d8-ae4f-6c429b7a1188 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:29.966153 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c81e4e25-e1ec-44d8-ae4f-6c429b7a1188 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:29.967591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c81e4e25-e1ec-44d8-ae4f-6c429b7a1188 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:29.968714 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c81e4e25-e1ec-44d8-ae4f-6c429b7a1188 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1407 microversion: 2.20 time: 0.161500 Aug 31 11:50:29.969845 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 456/912] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:29 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:50:30.598168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3b3cca4c-e017-415d-837c-0d6bb5ba5a48 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:30.598778 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3b3cca4c-e017-415d-837c-0d6bb5ba5a48 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:30.605867 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3b3cca4c-e017-415d-837c-0d6bb5ba5a48 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:30.606351 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3b3cca4c-e017-415d-837c-0d6bb5ba5a48 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:30.606782 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3b3cca4c-e017-415d-837c-0d6bb5ba5a48 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:30.607474 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3b3cca4c-e017-415d-837c-0d6bb5ba5a48 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:30.607920 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3b3cca4c-e017-415d-837c-0d6bb5ba5a48 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:30.608813 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3b3cca4c-e017-415d-837c-0d6bb5ba5a48 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:30.758915 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3b3cca4c-e017-415d-837c-0d6bb5ba5a48 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:30.766583 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3b3cca4c-e017-415d-837c-0d6bb5ba5a48 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1366 microversion: 2.1 time: 0.172864 Aug 31 11:50:30.767134 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 457/913] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:30 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:30.992723 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cc4fa5d3-24dc-4fef-ba8e-7ab1682afd4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:30.993393 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cc4fa5d3-24dc-4fef-ba8e-7ab1682afd4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:30.999846 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc4fa5d3-24dc-4fef-ba8e-7ab1682afd4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:31.001356 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc4fa5d3-24dc-4fef-ba8e-7ab1682afd4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:31.001791 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc4fa5d3-24dc-4fef-ba8e-7ab1682afd4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:31.002487 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc4fa5d3-24dc-4fef-ba8e-7ab1682afd4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:31.002934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc4fa5d3-24dc-4fef-ba8e-7ab1682afd4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:31.003353 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc4fa5d3-24dc-4fef-ba8e-7ab1682afd4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:31.231112 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cc4fa5d3-24dc-4fef-ba8e-7ab1682afd4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:31.239537 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cc4fa5d3-24dc-4fef-ba8e-7ab1682afd4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:31.241011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cc4fa5d3-24dc-4fef-ba8e-7ab1682afd4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:31.242919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cc4fa5d3-24dc-4fef-ba8e-7ab1682afd4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1407 microversion: 2.20 time: 0.254205 Aug 31 11:50:31.243651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 457/914] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:30 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:50:31.787016 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a3d2c095-659e-493b-8bf6-a3daa9783c2e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:31.787570 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a3d2c095-659e-493b-8bf6-a3daa9783c2e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:31.793995 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a3d2c095-659e-493b-8bf6-a3daa9783c2e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:31.794476 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a3d2c095-659e-493b-8bf6-a3daa9783c2e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:31.794920 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a3d2c095-659e-493b-8bf6-a3daa9783c2e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:31.795606 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a3d2c095-659e-493b-8bf6-a3daa9783c2e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:31.796057 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a3d2c095-659e-493b-8bf6-a3daa9783c2e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:31.796481 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a3d2c095-659e-493b-8bf6-a3daa9783c2e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:31.924472 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a3d2c095-659e-493b-8bf6-a3daa9783c2e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:31.932210 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a3d2c095-659e-493b-8bf6-a3daa9783c2e tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1366 microversion: 2.1 time: 0.149211 Aug 31 11:50:31.932825 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 458/915] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:31 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:32.266584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1023c9af-0bca-400c-bb0d-d60e19bd776e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:32.267194 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1023c9af-0bca-400c-bb0d-d60e19bd776e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:32.273611 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1023c9af-0bca-400c-bb0d-d60e19bd776e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:32.274095 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1023c9af-0bca-400c-bb0d-d60e19bd776e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:32.274531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1023c9af-0bca-400c-bb0d-d60e19bd776e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:32.275219 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1023c9af-0bca-400c-bb0d-d60e19bd776e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:32.275669 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1023c9af-0bca-400c-bb0d-d60e19bd776e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:32.276094 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-1023c9af-0bca-400c-bb0d-d60e19bd776e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:32.408555 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1023c9af-0bca-400c-bb0d-d60e19bd776e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:32.416604 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1023c9af-0bca-400c-bb0d-d60e19bd776e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:32.418039 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1023c9af-0bca-400c-bb0d-d60e19bd776e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:32.419140 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1023c9af-0bca-400c-bb0d-d60e19bd776e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1407 microversion: 2.20 time: 0.156995 Aug 31 11:50:32.419704 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 458/916] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:32 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:50:32.953766 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-38a51f3f-6289-43ce-930e-05ae2d405c01 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:32.954369 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-38a51f3f-6289-43ce-930e-05ae2d405c01 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:32.960620 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38a51f3f-6289-43ce-930e-05ae2d405c01 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:32.961109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38a51f3f-6289-43ce-930e-05ae2d405c01 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:32.961548 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38a51f3f-6289-43ce-930e-05ae2d405c01 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:32.962264 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38a51f3f-6289-43ce-930e-05ae2d405c01 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:32.962697 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38a51f3f-6289-43ce-930e-05ae2d405c01 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:32.963128 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38a51f3f-6289-43ce-930e-05ae2d405c01 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:33.096700 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-38a51f3f-6289-43ce-930e-05ae2d405c01 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:33.104389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-38a51f3f-6289-43ce-930e-05ae2d405c01 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1366 microversion: 2.1 time: 0.154632 Aug 31 11:50:33.104990 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 459/917] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:32 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:33.444407 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-38b57a85-ecad-4063-bc6c-01fce8b4e876 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:33.445054 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-38b57a85-ecad-4063-bc6c-01fce8b4e876 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:33.453214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-38b57a85-ecad-4063-bc6c-01fce8b4e876 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:33.454321 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-38b57a85-ecad-4063-bc6c-01fce8b4e876 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:33.454768 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-38b57a85-ecad-4063-bc6c-01fce8b4e876 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:33.455485 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-38b57a85-ecad-4063-bc6c-01fce8b4e876 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:33.455938 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-38b57a85-ecad-4063-bc6c-01fce8b4e876 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:33.456363 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-38b57a85-ecad-4063-bc6c-01fce8b4e876 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:33.588077 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-38b57a85-ecad-4063-bc6c-01fce8b4e876 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:33.596705 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-38b57a85-ecad-4063-bc6c-01fce8b4e876 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:33.598138 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-38b57a85-ecad-4063-bc6c-01fce8b4e876 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:33.599231 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-38b57a85-ecad-4063-bc6c-01fce8b4e876 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1407 microversion: 2.20 time: 0.160247 Aug 31 11:50:33.599791 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 459/918] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:33 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:50:34.125861 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-58ddf260-bf76-4caa-af17-2e30fb7684fe tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:34.126502 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-58ddf260-bf76-4caa-af17-2e30fb7684fe tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:34.132908 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-58ddf260-bf76-4caa-af17-2e30fb7684fe tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:34.133389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-58ddf260-bf76-4caa-af17-2e30fb7684fe tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:34.133822 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-58ddf260-bf76-4caa-af17-2e30fb7684fe tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:34.134504 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-58ddf260-bf76-4caa-af17-2e30fb7684fe tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:34.134950 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-58ddf260-bf76-4caa-af17-2e30fb7684fe tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:34.135372 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-58ddf260-bf76-4caa-af17-2e30fb7684fe tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:34.264513 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-58ddf260-bf76-4caa-af17-2e30fb7684fe tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:34.272120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-58ddf260-bf76-4caa-af17-2e30fb7684fe tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1366 microversion: 2.1 time: 0.150296 Aug 31 11:50:34.272706 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 460/919] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:34 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:34.622039 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4bd0e6cf-f56d-42d1-bd0e-256d88ae7587 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:34.622680 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4bd0e6cf-f56d-42d1-bd0e-256d88ae7587 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:34.629767 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4bd0e6cf-f56d-42d1-bd0e-256d88ae7587 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:34.630245 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4bd0e6cf-f56d-42d1-bd0e-256d88ae7587 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:34.630676 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4bd0e6cf-f56d-42d1-bd0e-256d88ae7587 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:34.631365 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4bd0e6cf-f56d-42d1-bd0e-256d88ae7587 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:34.631811 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4bd0e6cf-f56d-42d1-bd0e-256d88ae7587 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:34.632230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4bd0e6cf-f56d-42d1-bd0e-256d88ae7587 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:34.762564 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4bd0e6cf-f56d-42d1-bd0e-256d88ae7587 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:34.770638 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4bd0e6cf-f56d-42d1-bd0e-256d88ae7587 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:34.772066 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4bd0e6cf-f56d-42d1-bd0e-256d88ae7587 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:34.773199 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4bd0e6cf-f56d-42d1-bd0e-256d88ae7587 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1407 microversion: 2.20 time: 0.155049 Aug 31 11:50:34.773757 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 460/920] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:34 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:50:35.150010 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-8d2b2600-8832-4ab8-88ca-5475cc3b1ce2 req-282dcede-a3f0-4107-a99a-074fef7b9dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06aad3ea-8a4f-44c5-829c-b0230807fdf7", "name": "network-vif-plugged", "status": "completed", "tag": "936e8033-671c-4a3d-9abe-a63045a10877"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:35.160087 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-8d2b2600-8832-4ab8-88ca-5475cc3b1ce2 req-282dcede-a3f0-4107-a99a-074fef7b9dbd service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:35.160586 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-8d2b2600-8832-4ab8-88ca-5475cc3b1ce2 req-282dcede-a3f0-4107-a99a-074fef7b9dbd service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:35.167093 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-8d2b2600-8832-4ab8-88ca-5475cc3b1ce2 req-282dcede-a3f0-4107-a99a-074fef7b9dbd service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:35.178479 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-8d2b2600-8832-4ab8-88ca-5475cc3b1ce2 req-282dcede-a3f0-4107-a99a-074fef7b9dbd service nova] Creating event network-vif-plugged:936e8033-671c-4a3d-9abe-a63045a10877 for instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 on hv-cinder-83976 Aug 31 11:50:35.183609 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-8d2b2600-8832-4ab8-88ca-5475cc3b1ce2 req-282dcede-a3f0-4107-a99a-074fef7b9dbd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099887 Aug 31 11:50:35.184585 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 461/921] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:50:35.293271 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-08497f00-8cac-4512-8d9f-13f4fd44b7dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:35.293921 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-08497f00-8cac-4512-8d9f-13f4fd44b7dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:35.299873 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-08497f00-8cac-4512-8d9f-13f4fd44b7dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:35.300353 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-08497f00-8cac-4512-8d9f-13f4fd44b7dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:35.300803 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-08497f00-8cac-4512-8d9f-13f4fd44b7dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:35.301487 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-08497f00-8cac-4512-8d9f-13f4fd44b7dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:35.301927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-08497f00-8cac-4512-8d9f-13f4fd44b7dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:35.302339 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-08497f00-8cac-4512-8d9f-13f4fd44b7dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:35.484468 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-08497f00-8cac-4512-8d9f-13f4fd44b7dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:35.492732 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-08497f00-8cac-4512-8d9f-13f4fd44b7dd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1366 microversion: 2.1 time: 0.203228 Aug 31 11:50:35.494158 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 461/922] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:35 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:35.796564 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5863c3f0-1e01-4d84-9944-dba0e08ea46d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:35.797381 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5863c3f0-1e01-4d84-9944-dba0e08ea46d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:35.803476 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5863c3f0-1e01-4d84-9944-dba0e08ea46d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:35.803955 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5863c3f0-1e01-4d84-9944-dba0e08ea46d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:35.804387 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5863c3f0-1e01-4d84-9944-dba0e08ea46d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:35.805097 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5863c3f0-1e01-4d84-9944-dba0e08ea46d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:35.805857 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5863c3f0-1e01-4d84-9944-dba0e08ea46d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:35.805992 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5863c3f0-1e01-4d84-9944-dba0e08ea46d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:35.939907 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5863c3f0-1e01-4d84-9944-dba0e08ea46d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:35.948909 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5863c3f0-1e01-4d84-9944-dba0e08ea46d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:35.950334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5863c3f0-1e01-4d84-9944-dba0e08ea46d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:35.951417 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5863c3f0-1e01-4d84-9944-dba0e08ea46d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1407 microversion: 2.20 time: 0.159145 Aug 31 11:50:35.951962 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 462/923] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:35 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:50:36.515215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-864cbca4-58e2-4e18-83b6-ec45a1103489 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:36.515925 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-864cbca4-58e2-4e18-83b6-ec45a1103489 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:36.518381 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=4 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:50:36.519039 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=16 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:50:36.525461 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-864cbca4-58e2-4e18-83b6-ec45a1103489 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:36.525948 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-864cbca4-58e2-4e18-83b6-ec45a1103489 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:36.526376 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-864cbca4-58e2-4e18-83b6-ec45a1103489 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:36.527059 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-864cbca4-58e2-4e18-83b6-ec45a1103489 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:36.527507 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-864cbca4-58e2-4e18-83b6-ec45a1103489 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:36.527927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-864cbca4-58e2-4e18-83b6-ec45a1103489 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:36.661604 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-864cbca4-58e2-4e18-83b6-ec45a1103489 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:36.669497 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-864cbca4-58e2-4e18-83b6-ec45a1103489 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1366 microversion: 2.1 time: 0.158876 Aug 31 11:50:36.670048 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 462/924] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:36 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:36.974537 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-175b7a2f-f7e0-40e2-9a9b-4a7399ac9713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:36.975141 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-175b7a2f-f7e0-40e2-9a9b-4a7399ac9713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:36.977155 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=8 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:50:36.983237 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-175b7a2f-f7e0-40e2-9a9b-4a7399ac9713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:36.983728 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-175b7a2f-f7e0-40e2-9a9b-4a7399ac9713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:36.984198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-175b7a2f-f7e0-40e2-9a9b-4a7399ac9713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:36.984937 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-175b7a2f-f7e0-40e2-9a9b-4a7399ac9713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:36.985388 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-175b7a2f-f7e0-40e2-9a9b-4a7399ac9713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:36.985814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-175b7a2f-f7e0-40e2-9a9b-4a7399ac9713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:37.120036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-175b7a2f-f7e0-40e2-9a9b-4a7399ac9713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:37.128822 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-175b7a2f-f7e0-40e2-9a9b-4a7399ac9713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:37.130290 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-175b7a2f-f7e0-40e2-9a9b-4a7399ac9713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:37.131391 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-175b7a2f-f7e0-40e2-9a9b-4a7399ac9713 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1407 microversion: 2.20 time: 0.160782 Aug 31 11:50:37.131981 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 463/925] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:36 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:50:37.197964 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-4b583a83-4517-4cf3-bf71-9797753ec4e8 req-346f2c66-2a2a-4f32-8c51-e56111334058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a8e93a-cf62-4e41-98c8-a824827b2fda", "name": "network-vif-plugged", "status": "completed", "tag": "34bf57b1-b383-42f7-8724-12e4424e5e56"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:37.208236 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-4b583a83-4517-4cf3-bf71-9797753ec4e8 req-346f2c66-2a2a-4f32-8c51-e56111334058 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:37.208753 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-4b583a83-4517-4cf3-bf71-9797753ec4e8 req-346f2c66-2a2a-4f32-8c51-e56111334058 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:37.209179 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-4b583a83-4517-4cf3-bf71-9797753ec4e8 req-346f2c66-2a2a-4f32-8c51-e56111334058 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:37.220154 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-4b583a83-4517-4cf3-bf71-9797753ec4e8 req-346f2c66-2a2a-4f32-8c51-e56111334058 service nova] Creating event network-vif-plugged:34bf57b1-b383-42f7-8724-12e4424e5e56 for instance 95a8e93a-cf62-4e41-98c8-a824827b2fda on hv-cinder-83976 Aug 31 11:50:37.225110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-4b583a83-4517-4cf3-bf71-9797753ec4e8 req-346f2c66-2a2a-4f32-8c51-e56111334058 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030772 Aug 31 11:50:37.225715 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 463/926] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:50:37.690702 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5687f28d-7990-4fc7-beba-e41fefd8fbaf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:37.691317 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5687f28d-7990-4fc7-beba-e41fefd8fbaf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:37.697511 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5687f28d-7990-4fc7-beba-e41fefd8fbaf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:37.697996 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5687f28d-7990-4fc7-beba-e41fefd8fbaf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:37.698423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5687f28d-7990-4fc7-beba-e41fefd8fbaf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:37.699119 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5687f28d-7990-4fc7-beba-e41fefd8fbaf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:37.699567 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5687f28d-7990-4fc7-beba-e41fefd8fbaf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:37.699993 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5687f28d-7990-4fc7-beba-e41fefd8fbaf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:37.830902 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5687f28d-7990-4fc7-beba-e41fefd8fbaf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:37.838600 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5687f28d-7990-4fc7-beba-e41fefd8fbaf tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1366 microversion: 2.1 time: 0.151923 Aug 31 11:50:37.839158 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 464/927] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:37 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:38.154832 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8fb37f2c-3076-4d28-bccd-f9702789039a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:38.155513 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8fb37f2c-3076-4d28-bccd-f9702789039a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:38.162003 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8fb37f2c-3076-4d28-bccd-f9702789039a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:38.162477 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8fb37f2c-3076-4d28-bccd-f9702789039a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:38.162900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8fb37f2c-3076-4d28-bccd-f9702789039a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:38.163571 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8fb37f2c-3076-4d28-bccd-f9702789039a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:38.164011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8fb37f2c-3076-4d28-bccd-f9702789039a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:38.164422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8fb37f2c-3076-4d28-bccd-f9702789039a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:38.299832 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8fb37f2c-3076-4d28-bccd-f9702789039a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:38.311783 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8fb37f2c-3076-4d28-bccd-f9702789039a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:38.313843 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8fb37f2c-3076-4d28-bccd-f9702789039a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:38.314985 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8fb37f2c-3076-4d28-bccd-f9702789039a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1600 microversion: 2.20 time: 0.164411 Aug 31 11:50:38.315523 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 464/928] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:50:38 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:50:38.337129 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-91d2cf52-372c-4c23-bd48-b5aab6313db7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:38.337674 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-91d2cf52-372c-4c23-bd48-b5aab6313db7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:38.344099 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91d2cf52-372c-4c23-bd48-b5aab6313db7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:38.344612 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91d2cf52-372c-4c23-bd48-b5aab6313db7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:38.345050 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91d2cf52-372c-4c23-bd48-b5aab6313db7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:38.345746 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91d2cf52-372c-4c23-bd48-b5aab6313db7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:38.346203 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91d2cf52-372c-4c23-bd48-b5aab6313db7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:38.346629 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-91d2cf52-372c-4c23-bd48-b5aab6313db7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:38.423382 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-91d2cf52-372c-4c23-bd48-b5aab6313db7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090114 Aug 31 11:50:38.423973 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 465/929] 10.222.0.60 () {60 vars in 1316 bytes} [Wed Aug 31 11:50:38 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:50:38.858240 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2d90ab14-2cbd-490e-a55f-54fb95120c08 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:38.858942 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2d90ab14-2cbd-490e-a55f-54fb95120c08 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:38.865896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d90ab14-2cbd-490e-a55f-54fb95120c08 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:38.866387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d90ab14-2cbd-490e-a55f-54fb95120c08 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:38.866824 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d90ab14-2cbd-490e-a55f-54fb95120c08 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:38.867510 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d90ab14-2cbd-490e-a55f-54fb95120c08 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:38.867967 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d90ab14-2cbd-490e-a55f-54fb95120c08 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:38.868390 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d90ab14-2cbd-490e-a55f-54fb95120c08 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:39.002126 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2d90ab14-2cbd-490e-a55f-54fb95120c08 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:39.010033 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2d90ab14-2cbd-490e-a55f-54fb95120c08 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1366 microversion: 2.1 time: 0.155644 Aug 31 11:50:39.010604 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 465/930] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:38 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:39.385591 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-0d9047f4-0f3d-4746-8ee3-96df20adff9a req-e59d42ac-b1f5-493c-8a76-57f73564eabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06aad3ea-8a4f-44c5-829c-b0230807fdf7", "tag": "936e8033-671c-4a3d-9abe-a63045a10877"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:39.395022 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-0d9047f4-0f3d-4746-8ee3-96df20adff9a req-e59d42ac-b1f5-493c-8a76-57f73564eabd service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:39.395495 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-0d9047f4-0f3d-4746-8ee3-96df20adff9a req-e59d42ac-b1f5-493c-8a76-57f73564eabd service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:39.395920 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-0d9047f4-0f3d-4746-8ee3-96df20adff9a req-e59d42ac-b1f5-493c-8a76-57f73564eabd service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:39.408204 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-0d9047f4-0f3d-4746-8ee3-96df20adff9a req-e59d42ac-b1f5-493c-8a76-57f73564eabd service nova] Creating event network-changed:936e8033-671c-4a3d-9abe-a63045a10877 for instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 on hv-cinder-83976 Aug 31 11:50:39.413209 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-0d9047f4-0f3d-4746-8ee3-96df20adff9a req-e59d42ac-b1f5-493c-8a76-57f73564eabd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031835 Aug 31 11:50:39.413795 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 466/931] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:50:40.031549 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8b49b8c2-0312-4635-ac66-f8a8aa06e0a3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:40.032142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8b49b8c2-0312-4635-ac66-f8a8aa06e0a3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:40.040344 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8b49b8c2-0312-4635-ac66-f8a8aa06e0a3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:40.040955 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8b49b8c2-0312-4635-ac66-f8a8aa06e0a3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:40.041447 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8b49b8c2-0312-4635-ac66-f8a8aa06e0a3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:40.042314 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8b49b8c2-0312-4635-ac66-f8a8aa06e0a3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:40.042894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8b49b8c2-0312-4635-ac66-f8a8aa06e0a3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:40.043315 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8b49b8c2-0312-4635-ac66-f8a8aa06e0a3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:40.048254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:50:40.280237 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8b49b8c2-0312-4635-ac66-f8a8aa06e0a3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:50:40.289599 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8b49b8c2-0312-4635-ac66-f8a8aa06e0a3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1556 microversion: 2.1 time: 0.262184 Aug 31 11:50:40.290306 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 466/932] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:50:40 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1556 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:50:40.311711 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c6cd6d11-e267-4987-b761-fb39b037f306 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:50:40.312814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c6cd6d11-e267-4987-b761-fb39b037f306 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:50:40.320324 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c6cd6d11-e267-4987-b761-fb39b037f306 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:40.320848 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c6cd6d11-e267-4987-b761-fb39b037f306 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:40.321282 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c6cd6d11-e267-4987-b761-fb39b037f306 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:40.321986 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c6cd6d11-e267-4987-b761-fb39b037f306 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:40.322435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c6cd6d11-e267-4987-b761-fb39b037f306 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:40.322858 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c6cd6d11-e267-4987-b761-fb39b037f306 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:40.407010 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c6cd6d11-e267-4987-b761-fb39b037f306 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100017 Aug 31 11:50:40.407615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 467/933] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 31 11:50:40 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:50:41.428138 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-8b82699f-d69f-40e4-a0f6-b87a3241441d req-f21e1fd3-88a3-4381-ab4e-7f451e201709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a8e93a-cf62-4e41-98c8-a824827b2fda", "tag": "34bf57b1-b383-42f7-8724-12e4424e5e56"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:50:41.438189 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-8b82699f-d69f-40e4-a0f6-b87a3241441d req-f21e1fd3-88a3-4381-ab4e-7f451e201709 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:50:41.438762 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-8b82699f-d69f-40e4-a0f6-b87a3241441d req-f21e1fd3-88a3-4381-ab4e-7f451e201709 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:50:41.439195 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-8b82699f-d69f-40e4-a0f6-b87a3241441d req-f21e1fd3-88a3-4381-ab4e-7f451e201709 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:50:41.452094 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-8b82699f-d69f-40e4-a0f6-b87a3241441d req-f21e1fd3-88a3-4381-ab4e-7f451e201709 service nova] Creating event network-changed:34bf57b1-b383-42f7-8724-12e4424e5e56 for instance 95a8e93a-cf62-4e41-98c8-a824827b2fda on hv-cinder-83976 Aug 31 11:50:41.457891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-8b82699f-d69f-40e4-a0f6-b87a3241441d req-f21e1fd3-88a3-4381-ab4e-7f451e201709 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033345 Aug 31 11:50:41.458750 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 467/934] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:11.481899 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:51:11.482673 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=94 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:51:11.637830 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-40522794-5842-4e28-868c-adfb461c1147 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-452833918"}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:51:11.638359 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-40522794-5842-4e28-868c-adfb461c1147 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:11.644248 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40522794-5842-4e28-868c-adfb461c1147 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:11.644765 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40522794-5842-4e28-868c-adfb461c1147 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:11.645190 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40522794-5842-4e28-868c-adfb461c1147 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:11.645864 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40522794-5842-4e28-868c-adfb461c1147 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:11.646300 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40522794-5842-4e28-868c-adfb461c1147 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:11.646705 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40522794-5842-4e28-868c-adfb461c1147 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:11.776279 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.network.security_group_api [None req-40522794-5842-4e28-868c-adfb461c1147 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Removing security group ae3abcca-3884-4cf0-abaf-c85fbd6df12d from port 008c8ca4-7cac-42b6-9966-a441e62ec36a Aug 31 11:51:11.940853 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:51:11.941591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=6 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:51:11.946002 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4e1c7c19-fe55-4a6a-b0cf-778369f5de96 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:11.948211 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4e1c7c19-fe55-4a6a-b0cf-778369f5de96 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:11.956013 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4e1c7c19-fe55-4a6a-b0cf-778369f5de96 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:11.956528 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4e1c7c19-fe55-4a6a-b0cf-778369f5de96 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:11.956968 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4e1c7c19-fe55-4a6a-b0cf-778369f5de96 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:11.957662 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4e1c7c19-fe55-4a6a-b0cf-778369f5de96 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:11.958109 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4e1c7c19-fe55-4a6a-b0cf-778369f5de96 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:11.958529 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4e1c7c19-fe55-4a6a-b0cf-778369f5de96 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:11.989240 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4e1c7c19-fe55-4a6a-b0cf-778369f5de96 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050022 Aug 31 11:51:11.990043 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 468/935] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:51:11 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 11:51:12.051440 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-98975956-a34e-4807-adc1-78dcc4472038 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:12.051966 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-98975956-a34e-4807-adc1-78dcc4472038 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:12.058281 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98975956-a34e-4807-adc1-78dcc4472038 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:12.058763 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98975956-a34e-4807-adc1-78dcc4472038 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:12.059190 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98975956-a34e-4807-adc1-78dcc4472038 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:12.059872 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98975956-a34e-4807-adc1-78dcc4472038 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:12.060313 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98975956-a34e-4807-adc1-78dcc4472038 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:12.060764 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-98975956-a34e-4807-adc1-78dcc4472038 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:12.086437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-98975956-a34e-4807-adc1-78dcc4472038 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Going to try to terminate instance {{(pid=127062) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:51:12.101521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-40522794-5842-4e28-868c-adfb461c1147 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "POST /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/action" status: 202 len: 0 microversion: 2.1 time: 0.620036 Aug 31 11:51:12.102611 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 468/936] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 31 11:51:11 2022] POST /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/action => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:51:12.140219 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-75e002dd-db15-4010-94a3-650c25915d40 req-bf16be37-859c-4b9c-ad4a-375e283baaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30732ac7-790c-4585-9d27-a723b4a49095", "tag": "008c8ca4-7cac-42b6-9966-a441e62ec36a"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:51:12.157178 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-75e002dd-db15-4010-94a3-650c25915d40 req-bf16be37-859c-4b9c-ad4a-375e283baaf0 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:12.163527 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-75e002dd-db15-4010-94a3-650c25915d40 req-bf16be37-859c-4b9c-ad4a-375e283baaf0 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:12.164230 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-75e002dd-db15-4010-94a3-650c25915d40 req-bf16be37-859c-4b9c-ad4a-375e283baaf0 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:12.178252 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-75e002dd-db15-4010-94a3-650c25915d40 req-bf16be37-859c-4b9c-ad4a-375e283baaf0 service nova] Creating event network-changed:008c8ca4-7cac-42b6-9966-a441e62ec36a for instance 30732ac7-790c-4585-9d27-a723b4a49095 on hv-cinder-83976 Aug 31 11:51:12.184242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-75e002dd-db15-4010-94a3-650c25915d40 req-bf16be37-859c-4b9c-ad4a-375e283baaf0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048302 Aug 31 11:51:12.185576 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 469/937] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:12.208097 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-98975956-a34e-4807-adc1-78dcc4472038 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 204 len: 0 microversion: 2.1 time: 0.158800 Aug 31 11:51:12.208999 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 469/938] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:51:12 2022] DELETE /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:51:12.219413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-522dcd04-b81d-4a7c-ba21-d34502d694f9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:12.220132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-522dcd04-b81d-4a7c-ba21-d34502d694f9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:12.232410 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-522dcd04-b81d-4a7c-ba21-d34502d694f9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:12.233241 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-522dcd04-b81d-4a7c-ba21-d34502d694f9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:12.233879 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-522dcd04-b81d-4a7c-ba21-d34502d694f9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:12.234877 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-522dcd04-b81d-4a7c-ba21-d34502d694f9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:12.235498 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-522dcd04-b81d-4a7c-ba21-d34502d694f9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:12.236101 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-522dcd04-b81d-4a7c-ba21-d34502d694f9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:12.407320 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-522dcd04-b81d-4a7c-ba21-d34502d694f9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:12.419590 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-522dcd04-b81d-4a7c-ba21-d34502d694f9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1670 microversion: 2.1 time: 0.204471 Aug 31 11:51:12.422924 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 470/939] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:12 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1670 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:13.444166 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-bdbd6646-cd3d-4cfc-be07-58b369054f91 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:13.444885 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-bdbd6646-cd3d-4cfc-be07-58b369054f91 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:13.451183 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bdbd6646-cd3d-4cfc-be07-58b369054f91 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:13.451659 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bdbd6646-cd3d-4cfc-be07-58b369054f91 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:13.452702 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bdbd6646-cd3d-4cfc-be07-58b369054f91 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:13.453399 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bdbd6646-cd3d-4cfc-be07-58b369054f91 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:13.453999 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bdbd6646-cd3d-4cfc-be07-58b369054f91 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:13.454423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bdbd6646-cd3d-4cfc-be07-58b369054f91 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:13.785137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-bdbd6646-cd3d-4cfc-be07-58b369054f91 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:13.794925 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-bdbd6646-cd3d-4cfc-be07-58b369054f91 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1670 microversion: 2.1 time: 0.355103 Aug 31 11:51:13.795735 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fd99ffd8-fcda-471b-b6af-c0037a609882 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:13.796536 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fd99ffd8-fcda-471b-b6af-c0037a609882 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:13.797856 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 470/940] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:13 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1670 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:13.806408 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fd99ffd8-fcda-471b-b6af-c0037a609882 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:13.810989 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fd99ffd8-fcda-471b-b6af-c0037a609882 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:13.812287 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fd99ffd8-fcda-471b-b6af-c0037a609882 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:13.815475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fd99ffd8-fcda-471b-b6af-c0037a609882 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:13.816058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fd99ffd8-fcda-471b-b6af-c0037a609882 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:13.817493 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-2ad887d4-f217-4794-bed2-274da44ab155 req-6ab93451-b110-459f-a54e-f6a76f1b79ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30732ac7-790c-4585-9d27-a723b4a49095", "tag": "008c8ca4-7cac-42b6-9966-a441e62ec36a"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:51:13.824774 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fd99ffd8-fcda-471b-b6af-c0037a609882 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:13.828876 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-2ad887d4-f217-4794-bed2-274da44ab155 req-6ab93451-b110-459f-a54e-f6a76f1b79ad service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:13.829567 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-2ad887d4-f217-4794-bed2-274da44ab155 req-6ab93451-b110-459f-a54e-f6a76f1b79ad service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:13.829996 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-2ad887d4-f217-4794-bed2-274da44ab155 req-6ab93451-b110-459f-a54e-f6a76f1b79ad service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:13.841675 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-2ad887d4-f217-4794-bed2-274da44ab155 req-6ab93451-b110-459f-a54e-f6a76f1b79ad service nova] Creating event network-changed:008c8ca4-7cac-42b6-9966-a441e62ec36a for instance 30732ac7-790c-4585-9d27-a723b4a49095 on hv-cinder-83976 Aug 31 11:51:13.849185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-2ad887d4-f217-4794-bed2-274da44ab155 req-6ab93451-b110-459f-a54e-f6a76f1b79ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040691 Aug 31 11:51:13.850374 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 471/941] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:13.939681 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-fd99ffd8-fcda-471b-b6af-c0037a609882 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lazy-loading 'services' on Instance uuid 30732ac7-790c-4585-9d27-a723b4a49095 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:51:14.048546 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-fd99ffd8-fcda-471b-b6af-c0037a609882 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "DELETE /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/os-volume_attachments/f0105f8a-e6fa-4b0a-87ee-425820f43264" status: 202 len: 0 microversion: 2.1 time: 0.256588 Aug 31 11:51:14.049053 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 471/942] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 31 11:51:13 2022] DELETE /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/os-volume_attachments/f0105f8a-e6fa-4b0a-87ee-425820f43264 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:51:14.060043 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0f852d1c-6c87-42c8-bebb-9edf4e4976a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:14.063299 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0f852d1c-6c87-42c8-bebb-9edf4e4976a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:14.070167 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0f852d1c-6c87-42c8-bebb-9edf4e4976a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:14.070990 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0f852d1c-6c87-42c8-bebb-9edf4e4976a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:14.071756 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0f852d1c-6c87-42c8-bebb-9edf4e4976a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:14.072802 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0f852d1c-6c87-42c8-bebb-9edf4e4976a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:14.073512 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0f852d1c-6c87-42c8-bebb-9edf4e4976a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:14.074006 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0f852d1c-6c87-42c8-bebb-9edf4e4976a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:14.111374 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0f852d1c-6c87-42c8-bebb-9edf4e4976a1 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057243 Aug 31 11:51:14.118081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 472/943] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:51:14 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:14.462630 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-fb7a5fa9-527a-4e64-be50-047cf9833c1d req-095fdde6-0841-49a1-80d2-5cc4b029b83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cfd5ee-9585-4f45-b34a-b0e87ae35723", "name": "network-vif-deleted", "tag": "06958dff-75ee-4641-9552-3e8769a2f96e"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:51:14.472345 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-fb7a5fa9-527a-4e64-be50-047cf9833c1d req-095fdde6-0841-49a1-80d2-5cc4b029b83f service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:14.473207 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-fb7a5fa9-527a-4e64-be50-047cf9833c1d req-095fdde6-0841-49a1-80d2-5cc4b029b83f service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:14.473349 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-fb7a5fa9-527a-4e64-be50-047cf9833c1d req-095fdde6-0841-49a1-80d2-5cc4b029b83f service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:14.485542 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-fb7a5fa9-527a-4e64-be50-047cf9833c1d req-095fdde6-0841-49a1-80d2-5cc4b029b83f service nova] Creating event network-vif-deleted:06958dff-75ee-4641-9552-3e8769a2f96e for instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 on hv-cinder-83976 Aug 31 11:51:14.490673 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-fb7a5fa9-527a-4e64-be50-047cf9833c1d req-095fdde6-0841-49a1-80d2-5cc4b029b83f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031948 Aug 31 11:51:14.491454 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 472/944] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:14.823140 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9e40645c-6eb6-4341-b6f7-121a770c98c1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:14.823824 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9e40645c-6eb6-4341-b6f7-121a770c98c1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:14.831997 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9e40645c-6eb6-4341-b6f7-121a770c98c1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:14.832809 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9e40645c-6eb6-4341-b6f7-121a770c98c1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:14.833423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9e40645c-6eb6-4341-b6f7-121a770c98c1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:14.834343 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9e40645c-6eb6-4341-b6f7-121a770c98c1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:14.835039 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9e40645c-6eb6-4341-b6f7-121a770c98c1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:14.835625 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9e40645c-6eb6-4341-b6f7-121a770c98c1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:14.873680 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9e40645c-6eb6-4341-b6f7-121a770c98c1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:14.875050 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9e40645c-6eb6-4341-b6f7-121a770c98c1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:14.875725 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9e40645c-6eb6-4341-b6f7-121a770c98c1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:14.876345 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.objects.instance [None req-9e40645c-6eb6-4341-b6f7-121a770c98c1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lazy-loading 'fault' on Instance uuid c0cfd5ee-9585-4f45-b34a-b0e87ae35723 {{(pid=127062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:51:14.927492 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9e40645c-6eb6-4341-b6f7-121a770c98c1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:14.944290 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9e40645c-6eb6-4341-b6f7-121a770c98c1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 200 len: 1324 microversion: 2.1 time: 0.125604 Aug 31 11:51:14.960114 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 473/945] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:14 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 1324 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:15.123819 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a043081e-029b-48c4-a896-076180727c38 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:15.126219 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a043081e-029b-48c4-a896-076180727c38 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:15.141822 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a043081e-029b-48c4-a896-076180727c38 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:15.142634 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a043081e-029b-48c4-a896-076180727c38 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:15.145214 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a043081e-029b-48c4-a896-076180727c38 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:15.146198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a043081e-029b-48c4-a896-076180727c38 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:15.149044 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a043081e-029b-48c4-a896-076180727c38 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:15.149746 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a043081e-029b-48c4-a896-076180727c38 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:15.222314 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a043081e-029b-48c4-a896-076180727c38 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102657 Aug 31 11:51:15.223031 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 473/946] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:51:15 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:15.966743 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8e7360ed-2ccb-4a81-8a45-995e5e957cb1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:15.967329 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8e7360ed-2ccb-4a81-8a45-995e5e957cb1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:15.974920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e7360ed-2ccb-4a81-8a45-995e5e957cb1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:15.975403 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e7360ed-2ccb-4a81-8a45-995e5e957cb1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:15.975839 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e7360ed-2ccb-4a81-8a45-995e5e957cb1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:15.976557 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e7360ed-2ccb-4a81-8a45-995e5e957cb1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:15.977014 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e7360ed-2ccb-4a81-8a45-995e5e957cb1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:15.977438 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e7360ed-2ccb-4a81-8a45-995e5e957cb1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:15.991702 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-8e7360ed-2ccb-4a81-8a45-995e5e957cb1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] HTTP exception thrown: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8e7360ed-2ccb-4a81-8a45-995e5e957cb1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Request method failure captured: Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 HTTP/1.1 Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lKLIKalYDEcXIg7_ro7nu3mNW1K1GN7nlFNE0wqulh1xelYAuiEYi8z_C_ReFK9K09hMOscHuZY_k9cPFjIP96X5gV1Z5wSUw_2t7d9L86xi-8OPhbW-qeQo0OhwfBFipZtucSzhGlONzO9BvPdLxxuVRdYWc97Fhrm92yXUdEjWk Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: aacdfff11f2a41f889f7d7cdc41c12dc Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:51:15.993420 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:51:15.995084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aacdfff11f2a41f889f7d7cdc41c12dc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aacdfff11f2a41f889f7d7cdc41c12dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aacdfff11f2a41f889f7d7cdc41c12dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aacdfff11f2a41f889f7d7cdc41c12dc"}]}] Aug 31 11:51:15.995084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:51:15.995084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: aacdfff11f2a41f889f7d7cdc41c12dc Aug 31 11:51:15.995084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:51:15.995084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-AttachVolumeTestJSON-410514968-project Aug 31 11:51:15.995084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:51:15.995084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:51:15.995084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 38c4d208994a40fe82310adb18bb3547 Aug 31 11:51:15.995084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-AttachVolumeTestJSON-410514968-project Aug 31 11:51:15.995084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:51:15.995084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. Aug 31 11:51:15.995084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': 'c0cfd5ee-9585-4f45-b34a-b0e87ae35723'} Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:51:15.996180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. Aug 31 11:51:15.997720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:15.999908 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8e7360ed-2ccb-4a81-8a45-995e5e957cb1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Returning 404 to user: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:51:15.999908 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8e7360ed-2ccb-4a81-8a45-995e5e957cb1 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 404 len: 111 microversion: 2.1 time: 0.032140 Aug 31 11:51:15.999908 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 474/947] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:15 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:51:16.004337 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f8f5903a-bafb-43f4-9898-1cbf29e77c1a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '.version_select at 0x7f17380a2d30>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:16.023833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f8f5903a-bafb-43f4-9898-1cbf29e77c1a tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-4827966" status: 202 len: 0 microversion: 2.1 time: 0.023299 Aug 31 11:51:16.024400 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 474/948] 10.222.0.60 () {58 vars in 1212 bytes} [Wed Aug 31 11:51:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-4827966 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:51:16.235426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-fbef8d7c-7dd8-47ef-8ff7-894fff67d8a4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:16.237584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-fbef8d7c-7dd8-47ef-8ff7-894fff67d8a4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:16.244217 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fbef8d7c-7dd8-47ef-8ff7-894fff67d8a4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:16.244732 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fbef8d7c-7dd8-47ef-8ff7-894fff67d8a4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:16.245176 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fbef8d7c-7dd8-47ef-8ff7-894fff67d8a4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:16.245881 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fbef8d7c-7dd8-47ef-8ff7-894fff67d8a4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:16.246333 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fbef8d7c-7dd8-47ef-8ff7-894fff67d8a4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:16.246760 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fbef8d7c-7dd8-47ef-8ff7-894fff67d8a4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:16.279940 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-fbef8d7c-7dd8-47ef-8ff7-894fff67d8a4 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048832 Aug 31 11:51:16.281361 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 475/949] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:51:16 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:51:16.292068 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-909bd6cb-d50c-49e5-9dc4-97969372cd5b tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:16.292684 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-909bd6cb-d50c-49e5-9dc4-97969372cd5b tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:16.298764 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-909bd6cb-d50c-49e5-9dc4-97969372cd5b tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:16.299245 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-909bd6cb-d50c-49e5-9dc4-97969372cd5b tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:16.299672 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-909bd6cb-d50c-49e5-9dc4-97969372cd5b tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:16.300356 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-909bd6cb-d50c-49e5-9dc4-97969372cd5b tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:16.300894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-909bd6cb-d50c-49e5-9dc4-97969372cd5b tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:16.301311 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-909bd6cb-d50c-49e5-9dc4-97969372cd5b tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:16.379291 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-909bd6cb-d50c-49e5-9dc4-97969372cd5b tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] HTTP exception thrown: Instance 30732ac7-790c-4585-9d27-a723b4a49095 is not attached to volume f0105f8a-e6fa-4b0a-87ee-425820f43264 Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-909bd6cb-d50c-49e5-9dc4-97969372cd5b tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Request method failure captured: Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: DELETE /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/os-volume_attachments/f0105f8a-e6fa-4b0a-87ee-425820f43264 HTTP/1.1 Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0nuYOKpG__VERtmtzRqOq7SkEJtRXrWT50WvtuwoVSvyKO-1il21Da_lg_ZToQ33UsuChDOcI5KpgLwjwQiXeQgbiKp_e_ZeoqGEsexCXP0H980It-nygaXvlZ07SQms2nWi8U8z-22Z_Nm3rIcGToaYl11X0hBVtpGMtwStcCIZAg Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: e4e02b8409eb43e1bd1d68c79e985430 Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-TestMinimumBasicScenario-1621154574 Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:51:16.381718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:51:16.383298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e4e02b8409eb43e1bd1d68c79e985430", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e4e02b8409eb43e1bd1d68c79e985430"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e4e02b8409eb43e1bd1d68c79e985430"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e4e02b8409eb43e1bd1d68c79e985430"}]}] Aug 31 11:51:16.383298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-TestMinimumBasicScenario-1621154574 Aug 31 11:51:16.383298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: e4e02b8409eb43e1bd1d68c79e985430 Aug 31 11:51:16.383298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1621154574 Aug 31 11:51:16.383298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-TestMinimumBasicScenario-1621154574-project Aug 31 11:51:16.383298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:51:16.383298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:51:16.383298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 255f7abaa92444309e5bf97f9d91c840 Aug 31 11:51:16.383298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-TestMinimumBasicScenario-1621154574-project Aug 31 11:51:16.383298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:51:16.383298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 30732ac7-790c-4585-9d27-a723b4a49095 is not attached to volume f0105f8a-e6fa-4b0a-87ee-425820f43264 Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'server_id': '30732ac7-790c-4585-9d27-a723b4a49095', 'id': 'f0105f8a-e6fa-4b0a-87ee-425820f43264'} Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f0105f8a-e6fa-4b0a-87ee-425820f43264. Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:51:16.384205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:51:16.385641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:51:16.385641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 11:51:16.385641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 11:51:16.385641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30732ac7-790c-4585-9d27-a723b4a49095 is not attached to volume f0105f8a-e6fa-4b0a-87ee-425820f43264 Aug 31 11:51:16.385641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:51:16.385641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:51:16.385641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:51:16.385641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:16.385641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:51:16.385641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:51:16.385641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:51:16.385641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:51:16.385641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30732ac7-790c-4585-9d27-a723b4a49095 is not attached to volume f0105f8a-e6fa-4b0a-87ee-425820f43264 Aug 31 11:51:16.385641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:51:16.385641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-909bd6cb-d50c-49e5-9dc4-97969372cd5b tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Returning 404 to user: Instance 30732ac7-790c-4585-9d27-a723b4a49095 is not attached to volume f0105f8a-e6fa-4b0a-87ee-425820f43264 {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:51:16.386744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-909bd6cb-d50c-49e5-9dc4-97969372cd5b tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "DELETE /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/os-volume_attachments/f0105f8a-e6fa-4b0a-87ee-425820f43264" status: 404 len: 154 microversion: 2.1 time: 0.095398 Aug 31 11:51:16.386744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 475/950] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 31 11:51:16 2022] DELETE /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095/os-volume_attachments/f0105f8a-e6fa-4b0a-87ee-425820f43264 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:51:16.710214 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-dd5c9d44-196b-41ef-a8eb-0bc45c98c6ac tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Action: 'create', calling method: .version_select at 0x7f17347dd430>, body: {"keypair": {"name": "tempest-keypair-541095333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOt10/c0Uhy1q2jKyRnjfXjrstG7qIEiRO3syN3nv2v5g+cYW877k1IOod3J/KL105TNts/YfgS2DTsVrLyhZzjqToJdLY9bJsFnV+khx9iY72eHON5w7L81Yc+GlPce7Q=="}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:51:16.726313 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-dd5c9d44-196b-41ef-a8eb-0bc45c98c6ac tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Getting quotas for project aacdfff11f2a41f889f7d7cdc41c12dc. Resources: {'key_pairs'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:51:16.730379 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-dd5c9d44-196b-41ef-a8eb-0bc45c98c6ac tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Getting quotas for user 38c4d208994a40fe82310adb18bb3547 and project aacdfff11f2a41f889f7d7cdc41c12dc. Resources: {'key_pairs'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:51:16.753914 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-dd5c9d44-196b-41ef-a8eb-0bc45c98c6ac tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047577 Aug 31 11:51:16.754461 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 476/951] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 31 11:51:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:17.544840 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c0e1b6da-5eaf-49f4-8698-12eba5164e76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:17.545388 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c0e1b6da-5eaf-49f4-8698-12eba5164e76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:17.552682 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0e1b6da-5eaf-49f4-8698-12eba5164e76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:17.553166 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0e1b6da-5eaf-49f4-8698-12eba5164e76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:17.553597 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0e1b6da-5eaf-49f4-8698-12eba5164e76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:17.554354 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0e1b6da-5eaf-49f4-8698-12eba5164e76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:17.554742 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0e1b6da-5eaf-49f4-8698-12eba5164e76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:17.555163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c0e1b6da-5eaf-49f4-8698-12eba5164e76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:17.582079 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c0e1b6da-5eaf-49f4-8698-12eba5164e76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Going to try to terminate instance {{(pid=127061) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:51:17.666405 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c0e1b6da-5eaf-49f4-8698-12eba5164e76 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "DELETE /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 204 len: 0 microversion: 2.1 time: 0.125306 Aug 31 11:51:17.667200 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 476/952] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:51:17 2022] DELETE /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:51:17.677887 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-63d8a897-e434-424d-ac3e-d609f3ce7809 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:17.678769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-63d8a897-e434-424d-ac3e-d609f3ce7809 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:17.686624 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63d8a897-e434-424d-ac3e-d609f3ce7809 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:17.687362 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63d8a897-e434-424d-ac3e-d609f3ce7809 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:17.687836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63d8a897-e434-424d-ac3e-d609f3ce7809 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:17.688607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63d8a897-e434-424d-ac3e-d609f3ce7809 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:17.689365 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63d8a897-e434-424d-ac3e-d609f3ce7809 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:17.689789 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-63d8a897-e434-424d-ac3e-d609f3ce7809 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:17.911410 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-63d8a897-e434-424d-ac3e-d609f3ce7809 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:17.919437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-63d8a897-e434-424d-ac3e-d609f3ce7809 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1554 microversion: 2.1 time: 0.246495 Aug 31 11:51:17.920020 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 477/953] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:17 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1554 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:18.211055 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1056091989", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77a78692-a74d-4bab-91f2-992291597120"}], "security_groups": [{"name": "tempest-securitygroup--1813037364"}], "key_name": "tempest-keypair-541095333", "user_data": "}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:51:18.317087 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.network.neutron [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] validate_networks() for [('77a78692-a74d-4bab-91f2-992291597120', None, None, None, None, None)] {{(pid=127061) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:51:18.770658 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Flavor limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:51:18.771246 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Image limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:51:18.771534 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Flavor pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:51:18.771944 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Image pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:51:18.772349 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:51:18.781933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:18.782411 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:18.782849 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:18.783565 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:18.784014 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:18.784432 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:18.802598 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Getting quotas for project aacdfff11f2a41f889f7d7cdc41c12dc. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:51:18.806764 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Getting quotas for user 38c4d208994a40fe82310adb18bb3547 and project aacdfff11f2a41f889f7d7cdc41c12dc. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:51:18.818941 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Going to run 1 instances... {{(pid=127061) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:51:18.821385 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127061) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:51:18.870519 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-627586e1-0eb0-419b-9ab5-4ae87d5ec0da tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.664111 Aug 31 11:51:18.871152 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 477/954] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:51:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:51:18.883208 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6ba5d2a6-517d-4278-acf0-8f16a9d9109d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:18.883821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6ba5d2a6-517d-4278-acf0-8f16a9d9109d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:18.940101 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6ba5d2a6-517d-4278-acf0-8f16a9d9109d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:18.942713 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ceb0f131-d69b-4cd7-be04-7bcb060a293c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:18.943593 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ceb0f131-d69b-4cd7-be04-7bcb060a293c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:18.948676 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6ba5d2a6-517d-4278-acf0-8f16a9d9109d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1237 microversion: 2.1 time: 0.069198 Aug 31 11:51:18.949980 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 478/955] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:18 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:18.950253 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ceb0f131-d69b-4cd7-be04-7bcb060a293c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:18.950759 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ceb0f131-d69b-4cd7-be04-7bcb060a293c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:18.951188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ceb0f131-d69b-4cd7-be04-7bcb060a293c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:18.951896 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ceb0f131-d69b-4cd7-be04-7bcb060a293c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:18.952979 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ceb0f131-d69b-4cd7-be04-7bcb060a293c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:18.953721 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ceb0f131-d69b-4cd7-be04-7bcb060a293c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:19.094547 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ceb0f131-d69b-4cd7-be04-7bcb060a293c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:19.103986 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ceb0f131-d69b-4cd7-be04-7bcb060a293c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1554 microversion: 2.1 time: 0.165052 Aug 31 11:51:19.104582 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 478/956] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:18 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:51:19.971142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-08e02be8-e3a8-4231-aaff-2827e4312c76 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:19.971907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-08e02be8-e3a8-4231-aaff-2827e4312c76 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:19.979914 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-08e02be8-e3a8-4231-aaff-2827e4312c76 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:19.980535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-08e02be8-e3a8-4231-aaff-2827e4312c76 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:19.981047 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-08e02be8-e3a8-4231-aaff-2827e4312c76 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:19.981821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-08e02be8-e3a8-4231-aaff-2827e4312c76 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:19.982386 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-08e02be8-e3a8-4231-aaff-2827e4312c76 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:19.982883 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-08e02be8-e3a8-4231-aaff-2827e4312c76 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:20.051571 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-08e02be8-e3a8-4231-aaff-2827e4312c76 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:20.059344 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-08e02be8-e3a8-4231-aaff-2827e4312c76 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1289 microversion: 2.1 time: 0.092818 Aug 31 11:51:20.059920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 479/957] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:19 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:20.125828 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8d6518f7-4f63-4d36-bc6a-ed2697e037e9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:20.126442 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8d6518f7-4f63-4d36-bc6a-ed2697e037e9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:20.133357 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8d6518f7-4f63-4d36-bc6a-ed2697e037e9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:20.133844 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8d6518f7-4f63-4d36-bc6a-ed2697e037e9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:20.134279 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8d6518f7-4f63-4d36-bc6a-ed2697e037e9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:20.134987 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8d6518f7-4f63-4d36-bc6a-ed2697e037e9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:20.135443 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8d6518f7-4f63-4d36-bc6a-ed2697e037e9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:20.135877 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8d6518f7-4f63-4d36-bc6a-ed2697e037e9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:20.370014 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-1c58ff38-b25f-495f-8ca2-a7a8d234fa75 req-2af8eb47-1f7a-4ada-b06d-4887d776ea85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30732ac7-790c-4585-9d27-a723b4a49095", "name": "network-vif-deleted", "tag": "008c8ca4-7cac-42b6-9966-a441e62ec36a"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:51:20.373429 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8d6518f7-4f63-4d36-bc6a-ed2697e037e9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '255f7abaa92444309e5bf97f9d91c840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e02b8409eb43e1bd1d68c79e985430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:20.383882 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-1c58ff38-b25f-495f-8ca2-a7a8d234fa75 req-2af8eb47-1f7a-4ada-b06d-4887d776ea85 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:20.384405 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-1c58ff38-b25f-495f-8ca2-a7a8d234fa75 req-2af8eb47-1f7a-4ada-b06d-4887d776ea85 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:20.385708 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-1c58ff38-b25f-495f-8ca2-a7a8d234fa75 req-2af8eb47-1f7a-4ada-b06d-4887d776ea85 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:20.397653 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8d6518f7-4f63-4d36-bc6a-ed2697e037e9 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 200 len: 1554 microversion: 2.1 time: 0.276038 Aug 31 11:51:20.398868 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-1c58ff38-b25f-495f-8ca2-a7a8d234fa75 req-2af8eb47-1f7a-4ada-b06d-4887d776ea85 service nova] Creating event network-vif-deleted:008c8ca4-7cac-42b6-9966-a441e62ec36a for instance 30732ac7-790c-4585-9d27-a723b4a49095 on hv-cinder-83976 Aug 31 11:51:20.399166 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 479/958] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:20 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 1554 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:20.404525 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-1c58ff38-b25f-495f-8ca2-a7a8d234fa75 req-2af8eb47-1f7a-4ada-b06d-4887d776ea85 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040738 Aug 31 11:51:20.405846 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 480/959] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:51:21.080678 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ec5da9fe-21b7-4ce8-a798-8ea11f62ca10 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:21.081290 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ec5da9fe-21b7-4ce8-a798-8ea11f62ca10 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:21.088460 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ec5da9fe-21b7-4ce8-a798-8ea11f62ca10 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:21.089325 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ec5da9fe-21b7-4ce8-a798-8ea11f62ca10 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:21.089768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ec5da9fe-21b7-4ce8-a798-8ea11f62ca10 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:21.090477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ec5da9fe-21b7-4ce8-a798-8ea11f62ca10 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:21.090927 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ec5da9fe-21b7-4ce8-a798-8ea11f62ca10 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:21.091348 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ec5da9fe-21b7-4ce8-a798-8ea11f62ca10 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:21.351691 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ec5da9fe-21b7-4ce8-a798-8ea11f62ca10 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:21.361488 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ec5da9fe-21b7-4ce8-a798-8ea11f62ca10 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1363 microversion: 2.1 time: 0.285195 Aug 31 11:51:21.375680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 480/960] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:21 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:21.421703 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-aa5efb6a-4764-42eb-8a97-8b16cd286bc2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:21.422720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-aa5efb6a-4764-42eb-8a97-8b16cd286bc2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] [instance: 30732ac7-790c-4585-9d27-a723b4a49095] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:21.430672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-aa5efb6a-4764-42eb-8a97-8b16cd286bc2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:21.431307 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-aa5efb6a-4764-42eb-8a97-8b16cd286bc2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:21.431968 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-aa5efb6a-4764-42eb-8a97-8b16cd286bc2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:21.432786 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-aa5efb6a-4764-42eb-8a97-8b16cd286bc2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:21.433317 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-aa5efb6a-4764-42eb-8a97-8b16cd286bc2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:21.433819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-aa5efb6a-4764-42eb-8a97-8b16cd286bc2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:21.449470 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-aa5efb6a-4764-42eb-8a97-8b16cd286bc2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] HTTP exception thrown: Instance 30732ac7-790c-4585-9d27-a723b4a49095 could not be found. Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-aa5efb6a-4764-42eb-8a97-8b16cd286bc2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Request method failure captured: Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 HTTP/1.1 Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0nuYOKpG__VERtmtzRqOq7SkEJtRXrWT50WvtuwoVSvyKO-1il21Da_lg_ZToQ33UsuChDOcI5KpgLwjwQiXeQgbiKp_e_ZeoqGEsexCXP0H980It-nygaXvlZ07SQms2nWi8U8z-22Z_Nm3rIcGToaYl11X0hBVtpGMtwStcCIZAg Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: e4e02b8409eb43e1bd1d68c79e985430 Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-TestMinimumBasicScenario-1621154574 Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:51:21.450918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:51:21.452819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e4e02b8409eb43e1bd1d68c79e985430", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e4e02b8409eb43e1bd1d68c79e985430"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e4e02b8409eb43e1bd1d68c79e985430"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e4e02b8409eb43e1bd1d68c79e985430"}]}] Aug 31 11:51:21.452819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-TestMinimumBasicScenario-1621154574 Aug 31 11:51:21.452819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: e4e02b8409eb43e1bd1d68c79e985430 Aug 31 11:51:21.452819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1621154574 Aug 31 11:51:21.452819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-TestMinimumBasicScenario-1621154574-project Aug 31 11:51:21.452819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:51:21.452819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:51:21.452819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 255f7abaa92444309e5bf97f9d91c840 Aug 31 11:51:21.452819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-TestMinimumBasicScenario-1621154574-project Aug 31 11:51:21.452819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:51:21.452819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance 30732ac7-790c-4585-9d27-a723b4a49095 could not be found. Aug 31 11:51:21.452819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': '30732ac7-790c-4585-9d27-a723b4a49095'} Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30732ac7-790c-4585-9d27-a723b4a49095 could not be found. Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:51:21.453812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30732ac7-790c-4585-9d27-a723b4a49095 could not be found. Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30732ac7-790c-4585-9d27-a723b4a49095 could not be found. Aug 31 11:51:21.455977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:21.462399 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-aa5efb6a-4764-42eb-8a97-8b16cd286bc2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Returning 404 to user: Instance 30732ac7-790c-4585-9d27-a723b4a49095 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:51:21.462399 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-aa5efb6a-4764-42eb-8a97-8b16cd286bc2 tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095" status: 404 len: 111 microversion: 2.1 time: 0.038106 Aug 31 11:51:21.462399 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 481/961] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:21 2022] GET /compute/v2.1/servers/30732ac7-790c-4585-9d27-a723b4a49095 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:51:21.469496 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7c91cd16-b005-4cd1-a499-aea9e842a97c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] Calling method '.version_select at 0x7f17381c4af0>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:21.491296 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7c91cd16-b005-4cd1-a499-aea9e842a97c tempest-TestMinimumBasicScenario-1621154574 tempest-TestMinimumBasicScenario-1621154574-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1131327028" status: 202 len: 0 microversion: 2.1 time: 0.028544 Aug 31 11:51:21.491976 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 481/962] 10.222.0.60 () {58 vars in 1272 bytes} [Wed Aug 31 11:51:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1131327028 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:51:22.323419 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9257e89e-b166-4ba3-9c71-bafee977d3e9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:22.324002 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9257e89e-b166-4ba3-9c71-bafee977d3e9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:22.331074 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9257e89e-b166-4ba3-9c71-bafee977d3e9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:22.332444 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9257e89e-b166-4ba3-9c71-bafee977d3e9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:22.332981 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9257e89e-b166-4ba3-9c71-bafee977d3e9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:22.334268 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9257e89e-b166-4ba3-9c71-bafee977d3e9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:22.334806 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9257e89e-b166-4ba3-9c71-bafee977d3e9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:22.335304 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9257e89e-b166-4ba3-9c71-bafee977d3e9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:22.384638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a1557cef-e3c9-4109-abc5-95e5eedb9c62 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:22.385575 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a1557cef-e3c9-4109-abc5-95e5eedb9c62 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:22.393059 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1557cef-e3c9-4109-abc5-95e5eedb9c62 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:22.393693 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1557cef-e3c9-4109-abc5-95e5eedb9c62 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:22.394224 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1557cef-e3c9-4109-abc5-95e5eedb9c62 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:22.395032 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1557cef-e3c9-4109-abc5-95e5eedb9c62 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:22.395615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1557cef-e3c9-4109-abc5-95e5eedb9c62 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:22.396131 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1557cef-e3c9-4109-abc5-95e5eedb9c62 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:22.438699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.objects.instance [None req-9257e89e-b166-4ba3-9c71-bafee977d3e9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lazy-loading 'services' on Instance uuid 7a75232d-2df1-41c7-b73d-762fba8bd8e6 {{(pid=127062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:51:22.536313 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9257e89e-b166-4ba3-9c71-bafee977d3e9 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments/24674540-4608-45ff-8b48-edbb0a120d1e" status: 202 len: 0 microversion: 2.1 time: 0.218100 Aug 31 11:51:22.537334 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 482/963] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 31 11:51:22 2022] DELETE /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments/24674540-4608-45ff-8b48-edbb0a120d1e => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:51:22.551419 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-a8878278-c594-42b5-a6a3-effab58c797a req-da02dd32-41b9-423f-81fa-2602e223b21f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982", "tag": "dabf492f-7764-420d-a884-447e69ef70b7"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:51:22.560970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a1557cef-e3c9-4109-abc5-95e5eedb9c62 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:22.564252 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-a8878278-c594-42b5-a6a3-effab58c797a req-da02dd32-41b9-423f-81fa-2602e223b21f service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:22.564849 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-a8878278-c594-42b5-a6a3-effab58c797a req-da02dd32-41b9-423f-81fa-2602e223b21f service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:22.565292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-a8878278-c594-42b5-a6a3-effab58c797a req-da02dd32-41b9-423f-81fa-2602e223b21f service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:22.570673 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a1557cef-e3c9-4109-abc5-95e5eedb9c62 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1363 microversion: 2.1 time: 0.191099 Aug 31 11:51:22.578813 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-a8878278-c594-42b5-a6a3-effab58c797a req-da02dd32-41b9-423f-81fa-2602e223b21f service nova] Creating event network-changed:dabf492f-7764-420d-a884-447e69ef70b7 for instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 on hv-cinder-83976 Aug 31 11:51:22.583738 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-a8878278-c594-42b5-a6a3-effab58c797a req-da02dd32-41b9-423f-81fa-2602e223b21f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044624 Aug 31 11:51:22.584165 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 482/964] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:22 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:51:22.584400 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 483/965] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:22.589655 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ccb520cb-2438-4fa9-aed4-42a256c26226 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:22.592118 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ccb520cb-2438-4fa9-aed4-42a256c26226 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:22.598852 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ccb520cb-2438-4fa9-aed4-42a256c26226 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:22.599344 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ccb520cb-2438-4fa9-aed4-42a256c26226 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:22.599777 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ccb520cb-2438-4fa9-aed4-42a256c26226 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:22.600477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ccb520cb-2438-4fa9-aed4-42a256c26226 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:22.600957 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ccb520cb-2438-4fa9-aed4-42a256c26226 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:22.601383 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ccb520cb-2438-4fa9-aed4-42a256c26226 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:22.633237 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ccb520cb-2438-4fa9-aed4-42a256c26226 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047549 Aug 31 11:51:22.633811 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 483/966] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:51:22 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:23.592581 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8080e746-b6be-4141-8cda-892c4163d11f tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:23.593952 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8080e746-b6be-4141-8cda-892c4163d11f tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:23.600580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8080e746-b6be-4141-8cda-892c4163d11f tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:23.601078 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8080e746-b6be-4141-8cda-892c4163d11f tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:23.601517 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8080e746-b6be-4141-8cda-892c4163d11f tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:23.602246 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8080e746-b6be-4141-8cda-892c4163d11f tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:23.602707 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8080e746-b6be-4141-8cda-892c4163d11f tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:23.603133 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8080e746-b6be-4141-8cda-892c4163d11f tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:23.647803 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ad0a8135-6b9d-4bc7-a3d9-8c069595c772 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:23.649996 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ad0a8135-6b9d-4bc7-a3d9-8c069595c772 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:23.657041 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ad0a8135-6b9d-4bc7-a3d9-8c069595c772 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:23.657533 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ad0a8135-6b9d-4bc7-a3d9-8c069595c772 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:23.657968 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ad0a8135-6b9d-4bc7-a3d9-8c069595c772 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:23.658675 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ad0a8135-6b9d-4bc7-a3d9-8c069595c772 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:23.659125 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ad0a8135-6b9d-4bc7-a3d9-8c069595c772 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:23.659546 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ad0a8135-6b9d-4bc7-a3d9-8c069595c772 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:23.698568 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ad0a8135-6b9d-4bc7-a3d9-8c069595c772 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054789 Aug 31 11:51:23.699149 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 484/967] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:51:23 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:51:23.939927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8080e746-b6be-4141-8cda-892c4163d11f tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:23.947917 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8080e746-b6be-4141-8cda-892c4163d11f tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1363 microversion: 2.1 time: 0.360223 Aug 31 11:51:23.954455 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 484/968] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:23 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1363 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:24.712415 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c3105b23-f26d-4c15-aa78-a32aac3f7e8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:24.714598 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c3105b23-f26d-4c15-aa78-a32aac3f7e8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:24.721462 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3105b23-f26d-4c15-aa78-a32aac3f7e8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:24.721949 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3105b23-f26d-4c15-aa78-a32aac3f7e8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:24.722378 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3105b23-f26d-4c15-aa78-a32aac3f7e8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:24.723066 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3105b23-f26d-4c15-aa78-a32aac3f7e8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:24.723513 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3105b23-f26d-4c15-aa78-a32aac3f7e8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:24.723932 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c3105b23-f26d-4c15-aa78-a32aac3f7e8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:24.755970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c3105b23-f26d-4c15-aa78-a32aac3f7e8e tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047355 Aug 31 11:51:24.756457 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 485/969] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:51:24 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:24.971592 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2ad62185-d8d5-413d-ab9b-9d7f2baf2cd4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:24.974258 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2ad62185-d8d5-413d-ab9b-9d7f2baf2cd4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:24.986510 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ad62185-d8d5-413d-ab9b-9d7f2baf2cd4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:24.987374 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ad62185-d8d5-413d-ab9b-9d7f2baf2cd4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:24.988152 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ad62185-d8d5-413d-ab9b-9d7f2baf2cd4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:24.989456 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ad62185-d8d5-413d-ab9b-9d7f2baf2cd4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:24.990282 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ad62185-d8d5-413d-ab9b-9d7f2baf2cd4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:24.991055 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ad62185-d8d5-413d-ab9b-9d7f2baf2cd4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:25.251187 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2ad62185-d8d5-413d-ab9b-9d7f2baf2cd4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:25.260656 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2ad62185-d8d5-413d-ab9b-9d7f2baf2cd4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1363 microversion: 2.1 time: 0.294841 Aug 31 11:51:25.261244 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 485/970] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:24 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:51:25.767915 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a8bf4faf-14b8-477c-87f4-a561db879b65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:25.771006 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a8bf4faf-14b8-477c-87f4-a561db879b65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:25.787560 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a8bf4faf-14b8-477c-87f4-a561db879b65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:25.788482 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a8bf4faf-14b8-477c-87f4-a561db879b65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:25.789247 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a8bf4faf-14b8-477c-87f4-a561db879b65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:25.790447 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a8bf4faf-14b8-477c-87f4-a561db879b65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:25.790938 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a8bf4faf-14b8-477c-87f4-a561db879b65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:25.791704 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a8bf4faf-14b8-477c-87f4-a561db879b65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:25.841155 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:51:25.880974 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a8bf4faf-14b8-477c-87f4-a561db879b65 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117128 Aug 31 11:51:25.883376 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 486/971] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:51:25 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:26.282987 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7dd453c5-2ec2-40af-9376-61cdb953ec1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:26.283554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-7dd453c5-2ec2-40af-9376-61cdb953ec1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:26.290524 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7dd453c5-2ec2-40af-9376-61cdb953ec1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:26.291101 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7dd453c5-2ec2-40af-9376-61cdb953ec1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:26.291525 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7dd453c5-2ec2-40af-9376-61cdb953ec1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:26.292231 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7dd453c5-2ec2-40af-9376-61cdb953ec1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:26.292717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7dd453c5-2ec2-40af-9376-61cdb953ec1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:26.293142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7dd453c5-2ec2-40af-9376-61cdb953ec1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:26.439868 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-7dd453c5-2ec2-40af-9376-61cdb953ec1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:26.448407 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-7dd453c5-2ec2-40af-9376-61cdb953ec1b tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1363 microversion: 2.1 time: 0.169898 Aug 31 11:51:26.449031 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 486/972] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:26 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:26.895388 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4b68e0a1-1a72-4390-aa56-453e520c994c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:26.897684 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4b68e0a1-1a72-4390-aa56-453e520c994c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:26.904844 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4b68e0a1-1a72-4390-aa56-453e520c994c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:26.906641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4b68e0a1-1a72-4390-aa56-453e520c994c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:26.907100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4b68e0a1-1a72-4390-aa56-453e520c994c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:26.907948 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4b68e0a1-1a72-4390-aa56-453e520c994c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:26.908459 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4b68e0a1-1a72-4390-aa56-453e520c994c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:26.908890 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4b68e0a1-1a72-4390-aa56-453e520c994c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:26.943162 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4b68e0a1-1a72-4390-aa56-453e520c994c tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051812 Aug 31 11:51:26.943930 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 487/973] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:51:26 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:51:27.034061 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-972dd6bc-c863-47b7-8e98-bf4ab52d6d6f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:27.034579 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-972dd6bc-c863-47b7-8e98-bf4ab52d6d6f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:27.041145 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-972dd6bc-c863-47b7-8e98-bf4ab52d6d6f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:27.041642 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-972dd6bc-c863-47b7-8e98-bf4ab52d6d6f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:27.042365 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-972dd6bc-c863-47b7-8e98-bf4ab52d6d6f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:27.042788 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-972dd6bc-c863-47b7-8e98-bf4ab52d6d6f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:27.043240 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-972dd6bc-c863-47b7-8e98-bf4ab52d6d6f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:27.043666 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-972dd6bc-c863-47b7-8e98-bf4ab52d6d6f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:27.051178 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:51:27.074648 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-972dd6bc-c863-47b7-8e98-bf4ab52d6d6f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Going to try to terminate instance {{(pid=127062) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:51:27.168191 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-972dd6bc-c863-47b7-8e98-bf4ab52d6d6f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 204 len: 0 microversion: 2.1 time: 0.138543 Aug 31 11:51:27.169060 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 487/974] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:51:27 2022] DELETE /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:51:27.177197 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f6a0c6ec-5af0-41d3-ac00-4dcbcf222ae0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:27.177944 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f6a0c6ec-5af0-41d3-ac00-4dcbcf222ae0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:27.184161 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f6a0c6ec-5af0-41d3-ac00-4dcbcf222ae0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:27.184762 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f6a0c6ec-5af0-41d3-ac00-4dcbcf222ae0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:27.185265 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f6a0c6ec-5af0-41d3-ac00-4dcbcf222ae0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:27.186035 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f6a0c6ec-5af0-41d3-ac00-4dcbcf222ae0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:27.187042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f6a0c6ec-5af0-41d3-ac00-4dcbcf222ae0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:27.187167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f6a0c6ec-5af0-41d3-ac00-4dcbcf222ae0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:27.411514 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f6a0c6ec-5af0-41d3-ac00-4dcbcf222ae0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:27.422058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f6a0c6ec-5af0-41d3-ac00-4dcbcf222ae0 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1689 microversion: 2.1 time: 0.248701 Aug 31 11:51:27.422924 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 488/975] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:27 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1689 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:27.470406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-dd3c97d4-3afe-4bd5-91d9-5a6dd987d5b3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:27.471106 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-dd3c97d4-3afe-4bd5-91d9-5a6dd987d5b3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:27.478270 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd3c97d4-3afe-4bd5-91d9-5a6dd987d5b3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:27.478755 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd3c97d4-3afe-4bd5-91d9-5a6dd987d5b3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:27.479192 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd3c97d4-3afe-4bd5-91d9-5a6dd987d5b3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:27.479898 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd3c97d4-3afe-4bd5-91d9-5a6dd987d5b3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:27.480409 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd3c97d4-3afe-4bd5-91d9-5a6dd987d5b3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:27.480863 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dd3c97d4-3afe-4bd5-91d9-5a6dd987d5b3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:27.644381 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-dd3c97d4-3afe-4bd5-91d9-5a6dd987d5b3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:27.661155 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-dd3c97d4-3afe-4bd5-91d9-5a6dd987d5b3 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1363 microversion: 2.1 time: 0.195507 Aug 31 11:51:27.661755 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 488/976] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:27 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:28.443870 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4c8ace2a-8ad2-405e-a56b-6e2967753e4a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:28.444506 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4c8ace2a-8ad2-405e-a56b-6e2967753e4a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:28.451384 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c8ace2a-8ad2-405e-a56b-6e2967753e4a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:28.452215 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c8ace2a-8ad2-405e-a56b-6e2967753e4a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:28.453005 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c8ace2a-8ad2-405e-a56b-6e2967753e4a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:28.453962 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c8ace2a-8ad2-405e-a56b-6e2967753e4a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:28.454622 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c8ace2a-8ad2-405e-a56b-6e2967753e4a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:28.455050 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c8ace2a-8ad2-405e-a56b-6e2967753e4a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:28.598027 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4c8ace2a-8ad2-405e-a56b-6e2967753e4a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:28.605970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4c8ace2a-8ad2-405e-a56b-6e2967753e4a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1689 microversion: 2.1 time: 0.166107 Aug 31 11:51:28.606551 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 489/977] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:28 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:28.683210 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-35a1fa3f-ad53-4388-aef9-757b405b5497 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:28.683779 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-35a1fa3f-ad53-4388-aef9-757b405b5497 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:28.690478 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35a1fa3f-ad53-4388-aef9-757b405b5497 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:28.690960 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35a1fa3f-ad53-4388-aef9-757b405b5497 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:28.691415 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35a1fa3f-ad53-4388-aef9-757b405b5497 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:28.692110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35a1fa3f-ad53-4388-aef9-757b405b5497 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:28.692636 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35a1fa3f-ad53-4388-aef9-757b405b5497 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:28.693061 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35a1fa3f-ad53-4388-aef9-757b405b5497 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:28.871297 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-35a1fa3f-ad53-4388-aef9-757b405b5497 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:28.880000 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-35a1fa3f-ad53-4388-aef9-757b405b5497 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1363 microversion: 2.1 time: 0.200862 Aug 31 11:51:28.880631 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 489/978] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:28 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:29.308659 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-c0d1e38a-e14f-4e6c-8fb6-0633e178c9f7 req-4152a943-f3a5-47ea-bcbe-a088c9ac99df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982", "name": "network-vif-plugged", "status": "completed", "tag": "dabf492f-7764-420d-a884-447e69ef70b7"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:51:29.321374 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:51:29.322619 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=6 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:51:29.329929 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-c0d1e38a-e14f-4e6c-8fb6-0633e178c9f7 req-4152a943-f3a5-47ea-bcbe-a088c9ac99df service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:29.330748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-c0d1e38a-e14f-4e6c-8fb6-0633e178c9f7 req-4152a943-f3a5-47ea-bcbe-a088c9ac99df service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:29.331412 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-c0d1e38a-e14f-4e6c-8fb6-0633e178c9f7 req-4152a943-f3a5-47ea-bcbe-a088c9ac99df service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:29.345594 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-c0d1e38a-e14f-4e6c-8fb6-0633e178c9f7 req-4152a943-f3a5-47ea-bcbe-a088c9ac99df service nova] Creating event network-vif-plugged:dabf492f-7764-420d-a884-447e69ef70b7 for instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 on hv-cinder-83976 Aug 31 11:51:29.361861 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-c0d1e38a-e14f-4e6c-8fb6-0633e178c9f7 req-4152a943-f3a5-47ea-bcbe-a088c9ac99df service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060199 Aug 31 11:51:29.363014 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 490/979] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:29.627479 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9c1f9496-3994-4edf-88eb-b652b2ffcbd5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:29.628329 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9c1f9496-3994-4edf-88eb-b652b2ffcbd5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:29.630551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=6 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:51:29.642526 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9c1f9496-3994-4edf-88eb-b652b2ffcbd5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:29.643280 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9c1f9496-3994-4edf-88eb-b652b2ffcbd5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:29.643889 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9c1f9496-3994-4edf-88eb-b652b2ffcbd5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:29.645928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9c1f9496-3994-4edf-88eb-b652b2ffcbd5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:29.646957 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9c1f9496-3994-4edf-88eb-b652b2ffcbd5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:29.647550 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9c1f9496-3994-4edf-88eb-b652b2ffcbd5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:29.832979 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9c1f9496-3994-4edf-88eb-b652b2ffcbd5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:29.841308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9c1f9496-3994-4edf-88eb-b652b2ffcbd5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1689 microversion: 2.1 time: 0.217913 Aug 31 11:51:29.841868 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 490/980] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:29 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1689 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:29.901750 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d3687696-e954-4d45-9cdd-900ceaa3ae46 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:29.902440 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d3687696-e954-4d45-9cdd-900ceaa3ae46 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:29.909131 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d3687696-e954-4d45-9cdd-900ceaa3ae46 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:29.909609 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d3687696-e954-4d45-9cdd-900ceaa3ae46 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:29.910036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d3687696-e954-4d45-9cdd-900ceaa3ae46 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:29.910793 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d3687696-e954-4d45-9cdd-900ceaa3ae46 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:29.911244 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d3687696-e954-4d45-9cdd-900ceaa3ae46 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:29.911734 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d3687696-e954-4d45-9cdd-900ceaa3ae46 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:30.106993 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d3687696-e954-4d45-9cdd-900ceaa3ae46 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:30.117832 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d3687696-e954-4d45-9cdd-900ceaa3ae46 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1363 microversion: 2.1 time: 0.220435 Aug 31 11:51:30.118486 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 491/981] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:29 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:30.863150 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d6b7b42a-8dfe-4802-8d79-55413a415539 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:30.863992 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d6b7b42a-8dfe-4802-8d79-55413a415539 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:30.871512 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6b7b42a-8dfe-4802-8d79-55413a415539 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:30.872016 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6b7b42a-8dfe-4802-8d79-55413a415539 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:30.872449 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6b7b42a-8dfe-4802-8d79-55413a415539 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:30.873197 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6b7b42a-8dfe-4802-8d79-55413a415539 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:30.873722 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6b7b42a-8dfe-4802-8d79-55413a415539 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:30.874149 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6b7b42a-8dfe-4802-8d79-55413a415539 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:31.020171 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d6b7b42a-8dfe-4802-8d79-55413a415539 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:31.029533 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d6b7b42a-8dfe-4802-8d79-55413a415539 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1689 microversion: 2.1 time: 0.170541 Aug 31 11:51:31.030261 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 491/982] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:30 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:51:31.140933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-85bbb68b-9370-4af2-8fe3-8f2772685013 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:31.141533 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-85bbb68b-9370-4af2-8fe3-8f2772685013 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:31.148267 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-85bbb68b-9370-4af2-8fe3-8f2772685013 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:31.148780 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-85bbb68b-9370-4af2-8fe3-8f2772685013 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:31.149226 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-85bbb68b-9370-4af2-8fe3-8f2772685013 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:31.149913 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-85bbb68b-9370-4af2-8fe3-8f2772685013 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:31.150364 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-85bbb68b-9370-4af2-8fe3-8f2772685013 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:31.150788 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-85bbb68b-9370-4af2-8fe3-8f2772685013 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:31.282220 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-85bbb68b-9370-4af2-8fe3-8f2772685013 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:31.290297 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-85bbb68b-9370-4af2-8fe3-8f2772685013 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1363 microversion: 2.1 time: 0.154660 Aug 31 11:51:31.290858 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 492/983] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:31 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:32.052845 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-35fc11ee-043c-46e6-9545-75ede7602a7a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:32.053435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-35fc11ee-043c-46e6-9545-75ede7602a7a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:32.061725 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35fc11ee-043c-46e6-9545-75ede7602a7a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:32.062426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35fc11ee-043c-46e6-9545-75ede7602a7a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:32.062864 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35fc11ee-043c-46e6-9545-75ede7602a7a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:32.063578 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35fc11ee-043c-46e6-9545-75ede7602a7a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:32.064032 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35fc11ee-043c-46e6-9545-75ede7602a7a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:32.064459 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35fc11ee-043c-46e6-9545-75ede7602a7a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:32.147607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-35fc11ee-043c-46e6-9545-75ede7602a7a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:32.156587 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-35fc11ee-043c-46e6-9545-75ede7602a7a tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 200 len: 1622 microversion: 2.1 time: 0.107968 Aug 31 11:51:32.157174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 492/984] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:32 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 1622 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:32.276663 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-61487d87-fecb-4929-8445-f217dffae802 req-63d0c6f1-d310-4372-98a9-60f86c94f47a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a75232d-2df1-41c7-b73d-762fba8bd8e6", "name": "network-vif-deleted", "tag": "e4add15e-9a0d-473c-9f93-9c2dbb5dee25"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:51:32.289138 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-61487d87-fecb-4929-8445-f217dffae802 req-63d0c6f1-d310-4372-98a9-60f86c94f47a service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:32.289839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-61487d87-fecb-4929-8445-f217dffae802 req-63d0c6f1-d310-4372-98a9-60f86c94f47a service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:32.290574 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-61487d87-fecb-4929-8445-f217dffae802 req-63d0c6f1-d310-4372-98a9-60f86c94f47a service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:32.313682 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-61487d87-fecb-4929-8445-f217dffae802 req-63d0c6f1-d310-4372-98a9-60f86c94f47a service nova] Creating event network-vif-deleted:e4add15e-9a0d-473c-9f93-9c2dbb5dee25 for instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 on hv-cinder-83976 Aug 31 11:51:32.314230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-745adaa0-1050-4eaa-8d68-35c5cbf81a92 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:32.314847 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-745adaa0-1050-4eaa-8d68-35c5cbf81a92 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:32.322971 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-61487d87-fecb-4929-8445-f217dffae802 req-63d0c6f1-d310-4372-98a9-60f86c94f47a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064958 Aug 31 11:51:32.324310 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 493/985] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:51:32.326235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-745adaa0-1050-4eaa-8d68-35c5cbf81a92 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:32.328448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-745adaa0-1050-4eaa-8d68-35c5cbf81a92 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:32.331246 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-745adaa0-1050-4eaa-8d68-35c5cbf81a92 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:32.332230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-745adaa0-1050-4eaa-8d68-35c5cbf81a92 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:32.332907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-745adaa0-1050-4eaa-8d68-35c5cbf81a92 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:32.333341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-745adaa0-1050-4eaa-8d68-35c5cbf81a92 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:32.520291 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-745adaa0-1050-4eaa-8d68-35c5cbf81a92 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:32.532535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-745adaa0-1050-4eaa-8d68-35c5cbf81a92 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1549 microversion: 2.1 time: 0.223261 Aug 31 11:51:32.533132 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 493/986] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:32 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1549 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:51:32.554380 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bc3fd191-6cf6-48f1-bc1e-d649f5ebfcdf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:32.555190 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-bc3fd191-6cf6-48f1-bc1e-d649f5ebfcdf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:32.561975 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc3fd191-6cf6-48f1-bc1e-d649f5ebfcdf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:32.562459 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc3fd191-6cf6-48f1-bc1e-d649f5ebfcdf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:32.562924 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc3fd191-6cf6-48f1-bc1e-d649f5ebfcdf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:32.563612 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc3fd191-6cf6-48f1-bc1e-d649f5ebfcdf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:32.564059 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc3fd191-6cf6-48f1-bc1e-d649f5ebfcdf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:32.564484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bc3fd191-6cf6-48f1-bc1e-d649f5ebfcdf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:32.658257 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-bc3fd191-6cf6-48f1-bc1e-d649f5ebfcdf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108253 Aug 31 11:51:32.658768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 494/987] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 31 11:51:32 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:33.181324 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6fc2ebe4-4ea5-42b0-9136-d95ae6508d07 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:33.183397 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6fc2ebe4-4ea5-42b0-9136-d95ae6508d07 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 7a75232d-2df1-41c7-b73d-762fba8bd8e6] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:33.191003 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6fc2ebe4-4ea5-42b0-9136-d95ae6508d07 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:33.191494 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6fc2ebe4-4ea5-42b0-9136-d95ae6508d07 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:33.191928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6fc2ebe4-4ea5-42b0-9136-d95ae6508d07 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:33.192702 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6fc2ebe4-4ea5-42b0-9136-d95ae6508d07 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:33.193158 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6fc2ebe4-4ea5-42b0-9136-d95ae6508d07 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:33.193852 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6fc2ebe4-4ea5-42b0-9136-d95ae6508d07 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:33.210694 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-6fc2ebe4-4ea5-42b0-9136-d95ae6508d07 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] HTTP exception thrown: Instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 could not be found. Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6fc2ebe4-4ea5-42b0-9136-d95ae6508d07 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Request method failure captured: Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 HTTP/1.1 Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lTBYSI4Ellx1xSTrjGIoKiHgxhum85uyJe7v4p_7ezDgEUywOkeRvVgpwndDzyP6iljpAIyETuLAQabjcJl_KtU2r016DHL9lHZfhqzY9WRA62hsyCCf3I5xWBvvNZ5KLZHqUR5mR5wFwxzMbvDmChRreNmXS89FadI3ywt7qNUEw Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 0e110109075848a89e6ae1d516de9784 Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2086882469 Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:51:33.212697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:51:33.214170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0e110109075848a89e6ae1d516de9784", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0e110109075848a89e6ae1d516de9784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e110109075848a89e6ae1d516de9784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e110109075848a89e6ae1d516de9784"}]}] Aug 31 11:51:33.214170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2086882469 Aug 31 11:51:33.214170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 0e110109075848a89e6ae1d516de9784 Aug 31 11:51:33.214170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2086882469 Aug 31 11:51:33.214170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-ServerRescueNegativeTestJSON-2086882469-project Aug 31 11:51:33.214170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:51:33.214170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:51:33.214170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 38ea91bf04e741c793e4a06db9fb046f Aug 31 11:51:33.214170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2086882469-project Aug 31 11:51:33.214170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:51:33.214170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 could not be found. Aug 31 11:51:33.214170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': '7a75232d-2df1-41c7-b73d-762fba8bd8e6'} Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 could not be found. Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:51:33.214907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 could not be found. Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 could not be found. Aug 31 11:51:33.216100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:33.218983 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6fc2ebe4-4ea5-42b0-9136-d95ae6508d07 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Returning 404 to user: Instance 7a75232d-2df1-41c7-b73d-762fba8bd8e6 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:51:33.218983 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6fc2ebe4-4ea5-42b0-9136-d95ae6508d07 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6" status: 404 len: 111 microversion: 2.1 time: 0.038186 Aug 31 11:51:33.218983 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 494/988] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:33 2022] GET /compute/v2.1/servers/7a75232d-2df1-41c7-b73d-762fba8bd8e6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:51:33.224741 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-62b35866-c690-448a-9db8-eb61ccd59e44 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '.version_select at 0x7f173819d820>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:33.244685 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-62b35866-c690-448a-9db8-eb61ccd59e44 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-485942118" status: 202 len: 0 microversion: 2.1 time: 0.023774 Aug 31 11:51:33.245275 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 495/989] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Aug 31 11:51:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-485942118 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:51:34.045706 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-8a6dd385-ccff-46f9-887f-8ae8673ec94d req-8e69616a-5de7-4fc8-b691-8b4701676848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982", "tag": "dabf492f-7764-420d-a884-447e69ef70b7"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:51:34.055656 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-8a6dd385-ccff-46f9-887f-8ae8673ec94d req-8e69616a-5de7-4fc8-b691-8b4701676848 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:34.056435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-8a6dd385-ccff-46f9-887f-8ae8673ec94d req-8e69616a-5de7-4fc8-b691-8b4701676848 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:34.056882 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-8a6dd385-ccff-46f9-887f-8ae8673ec94d req-8e69616a-5de7-4fc8-b691-8b4701676848 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:34.070690 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-8a6dd385-ccff-46f9-887f-8ae8673ec94d req-8e69616a-5de7-4fc8-b691-8b4701676848 service nova] Creating event network-changed:dabf492f-7764-420d-a884-447e69ef70b7 for instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 on hv-cinder-83976 Aug 31 11:51:34.077579 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-8a6dd385-ccff-46f9-887f-8ae8673ec94d req-8e69616a-5de7-4fc8-b691-8b4701676848 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034623 Aug 31 11:51:34.078404 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 495/990] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:36.607567 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-68d0044b-c4b2-449f-b98f-d7799b498f49 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:36.608808 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-68d0044b-c4b2-449f-b98f-d7799b498f49 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:36.615064 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-68d0044b-c4b2-449f-b98f-d7799b498f49 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:36.615542 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-68d0044b-c4b2-449f-b98f-d7799b498f49 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:36.615980 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-68d0044b-c4b2-449f-b98f-d7799b498f49 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:36.616732 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-68d0044b-c4b2-449f-b98f-d7799b498f49 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:36.617178 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-68d0044b-c4b2-449f-b98f-d7799b498f49 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:36.617653 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-68d0044b-c4b2-449f-b98f-d7799b498f49 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:36.644342 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-68d0044b-c4b2-449f-b98f-d7799b498f49 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Going to try to terminate instance {{(pid=127061) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:51:36.729493 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-68d0044b-c4b2-449f-b98f-d7799b498f49 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 204 len: 0 microversion: 2.1 time: 0.126035 Aug 31 11:51:36.730885 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 496/991] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:51:36 2022] DELETE /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:51:36.740337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-accad1c6-1b3d-4900-90e3-f6f55fb56a91 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:36.741075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-accad1c6-1b3d-4900-90e3-f6f55fb56a91 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:36.747908 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-accad1c6-1b3d-4900-90e3-f6f55fb56a91 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:36.748388 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-accad1c6-1b3d-4900-90e3-f6f55fb56a91 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:36.748923 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-accad1c6-1b3d-4900-90e3-f6f55fb56a91 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:36.749639 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-accad1c6-1b3d-4900-90e3-f6f55fb56a91 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:36.750071 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-accad1c6-1b3d-4900-90e3-f6f55fb56a91 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:36.750492 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-accad1c6-1b3d-4900-90e3-f6f55fb56a91 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:36.889805 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-accad1c6-1b3d-4900-90e3-f6f55fb56a91 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:36.899100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-accad1c6-1b3d-4900-90e3-f6f55fb56a91 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1507 microversion: 2.1 time: 0.163045 Aug 31 11:51:36.899831 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 496/992] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:36 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:37.923694 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-f4b887b0-25dc-4d61-afe6-d813cb748a86 req-f4030be8-4505-48cc-8525-81e2a48605cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a562f1ce-b46b-464a-9a4c-a9963f56dceb", "name": "network-vif-deleted", "tag": "2c28681a-1560-4376-a0ce-7c613cf6890b"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:51:37.928838 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-17f7de80-e327-4489-9695-1c0c5546dade tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:37.930170 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-17f7de80-e327-4489-9695-1c0c5546dade tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:37.937120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-17f7de80-e327-4489-9695-1c0c5546dade tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:37.937850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-17f7de80-e327-4489-9695-1c0c5546dade tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:37.938452 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-17f7de80-e327-4489-9695-1c0c5546dade tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:37.939414 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-17f7de80-e327-4489-9695-1c0c5546dade tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:37.939556 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-f4b887b0-25dc-4d61-afe6-d813cb748a86 req-f4030be8-4505-48cc-8525-81e2a48605cd service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:37.940037 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-f4b887b0-25dc-4d61-afe6-d813cb748a86 req-f4030be8-4505-48cc-8525-81e2a48605cd service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:37.940443 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-17f7de80-e327-4489-9695-1c0c5546dade tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:37.940606 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-f4b887b0-25dc-4d61-afe6-d813cb748a86 req-f4030be8-4505-48cc-8525-81e2a48605cd service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:37.941269 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-17f7de80-e327-4489-9695-1c0c5546dade tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:37.955135 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-f4b887b0-25dc-4d61-afe6-d813cb748a86 req-f4030be8-4505-48cc-8525-81e2a48605cd service nova] Creating event network-vif-deleted:2c28681a-1560-4376-a0ce-7c613cf6890b for instance a562f1ce-b46b-464a-9a4c-a9963f56dceb on hv-cinder-83976 Aug 31 11:51:37.960852 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-f4b887b0-25dc-4d61-afe6-d813cb748a86 req-f4030be8-4505-48cc-8525-81e2a48605cd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041338 Aug 31 11:51:37.961576 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 497/993] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:38.020088 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-17f7de80-e327-4489-9695-1c0c5546dade tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:38.028011 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-17f7de80-e327-4489-9695-1c0c5546dade tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 200 len: 1465 microversion: 2.1 time: 0.110006 Aug 31 11:51:38.028605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 497/994] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:37 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 1465 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:39.051553 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0e06271c-46d3-4a11-a12e-01756329793f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:39.052229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0e06271c-46d3-4a11-a12e-01756329793f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: a562f1ce-b46b-464a-9a4c-a9963f56dceb] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:39.058837 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0e06271c-46d3-4a11-a12e-01756329793f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:39.059337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0e06271c-46d3-4a11-a12e-01756329793f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:39.059795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0e06271c-46d3-4a11-a12e-01756329793f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:39.060581 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0e06271c-46d3-4a11-a12e-01756329793f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:39.061652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0e06271c-46d3-4a11-a12e-01756329793f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:39.062121 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0e06271c-46d3-4a11-a12e-01756329793f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:39.076838 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-0e06271c-46d3-4a11-a12e-01756329793f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] HTTP exception thrown: Instance a562f1ce-b46b-464a-9a4c-a9963f56dceb could not be found. Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0e06271c-46d3-4a11-a12e-01756329793f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Request method failure captured: Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb HTTP/1.1 Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lTBYSI4Ellx1xSTrjGIoKiHgxhum85uyJe7v4p_7ezDgEUywOkeRvVgpwndDzyP6iljpAIyETuLAQabjcJl_KtU2r016DHL9lHZfhqzY9WRA62hsyCCf3I5xWBvvNZ5KLZHqUR5mR5wFwxzMbvDmChRreNmXS89FadI3ywt7qNUEw Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 0e110109075848a89e6ae1d516de9784 Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2086882469 Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:51:39.078559 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:51:39.080139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0e110109075848a89e6ae1d516de9784", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0e110109075848a89e6ae1d516de9784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e110109075848a89e6ae1d516de9784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e110109075848a89e6ae1d516de9784"}]}] Aug 31 11:51:39.080139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2086882469 Aug 31 11:51:39.080139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 0e110109075848a89e6ae1d516de9784 Aug 31 11:51:39.080139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2086882469 Aug 31 11:51:39.080139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-ServerRescueNegativeTestJSON-2086882469-project Aug 31 11:51:39.080139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:51:39.080139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:51:39.080139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 38ea91bf04e741c793e4a06db9fb046f Aug 31 11:51:39.080139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2086882469-project Aug 31 11:51:39.080139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:51:39.080139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance a562f1ce-b46b-464a-9a4c-a9963f56dceb could not be found. Aug 31 11:51:39.080139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': 'a562f1ce-b46b-464a-9a4c-a9963f56dceb'} Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a562f1ce-b46b-464a-9a4c-a9963f56dceb could not be found. Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:51:39.081075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a562f1ce-b46b-464a-9a4c-a9963f56dceb could not be found. Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a562f1ce-b46b-464a-9a4c-a9963f56dceb could not be found. Aug 31 11:51:39.082543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:51:39.083763 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0e06271c-46d3-4a11-a12e-01756329793f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Returning 404 to user: Instance a562f1ce-b46b-464a-9a4c-a9963f56dceb could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:51:39.083763 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0e06271c-46d3-4a11-a12e-01756329793f tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb" status: 404 len: 111 microversion: 2.1 time: 0.034322 Aug 31 11:51:39.083763 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 498/995] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:39 2022] GET /compute/v2.1/servers/a562f1ce-b46b-464a-9a4c-a9963f56dceb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:51:39.088922 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fa74d71d-4368-4243-9938-b501592b4ff5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:39.089406 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fa74d71d-4368-4243-9938-b501592b4ff5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:39.096740 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa74d71d-4368-4243-9938-b501592b4ff5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:39.097239 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa74d71d-4368-4243-9938-b501592b4ff5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:39.097680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa74d71d-4368-4243-9938-b501592b4ff5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:39.098416 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa74d71d-4368-4243-9938-b501592b4ff5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:39.098869 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa74d71d-4368-4243-9938-b501592b4ff5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:39.099314 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fa74d71d-4368-4243-9938-b501592b4ff5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:39.129032 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fa74d71d-4368-4243-9938-b501592b4ff5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Going to try to terminate instance {{(pid=127061) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:51:39.197849 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:51:39.209300 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-fa74d71d-4368-4243-9938-b501592b4ff5 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 204 len: 0 microversion: 2.1 time: 0.123831 Aug 31 11:51:39.210075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 498/996] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:51:39 2022] DELETE /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:51:39.222759 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-49ddafab-41dc-4813-8881-d28df5b1f4a6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:39.223525 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-49ddafab-41dc-4813-8881-d28df5b1f4a6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:39.229571 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-49ddafab-41dc-4813-8881-d28df5b1f4a6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:39.230057 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-49ddafab-41dc-4813-8881-d28df5b1f4a6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:39.230494 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-49ddafab-41dc-4813-8881-d28df5b1f4a6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:39.231196 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-49ddafab-41dc-4813-8881-d28df5b1f4a6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:39.231645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-49ddafab-41dc-4813-8881-d28df5b1f4a6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:39.232076 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-49ddafab-41dc-4813-8881-d28df5b1f4a6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:39.377508 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-49ddafab-41dc-4813-8881-d28df5b1f4a6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:39.385495 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-49ddafab-41dc-4813-8881-d28df5b1f4a6 tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1521 microversion: 2.1 time: 0.171137 Aug 31 11:51:39.386065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 499/997] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:39 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:51:40.376351 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-79b0da64-2485-45da-8113-46f81100d8f6 req-9c900656-194d-42f6-990e-0979d32518ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab", "name": "network-vif-deleted", "tag": "12ad6e71-b8c7-4384-9cc1-59620a27059b"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:51:40.392343 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-79b0da64-2485-45da-8113-46f81100d8f6 req-9c900656-194d-42f6-990e-0979d32518ec service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:40.392849 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-79b0da64-2485-45da-8113-46f81100d8f6 req-9c900656-194d-42f6-990e-0979d32518ec service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:40.393273 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-79b0da64-2485-45da-8113-46f81100d8f6 req-9c900656-194d-42f6-990e-0979d32518ec service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:40.405709 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-79b0da64-2485-45da-8113-46f81100d8f6 req-9c900656-194d-42f6-990e-0979d32518ec service nova] Creating event network-vif-deleted:12ad6e71-b8c7-4384-9cc1-59620a27059b for instance 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab on hv-cinder-83976 Aug 31 11:51:40.408437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4ca34e7c-9641-4a07-9469-ba219727388b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:40.409078 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4ca34e7c-9641-4a07-9469-ba219727388b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:40.411756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-79b0da64-2485-45da-8113-46f81100d8f6 req-9c900656-194d-42f6-990e-0979d32518ec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040549 Aug 31 11:51:40.412535 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 499/998] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:51:40.416579 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4ca34e7c-9641-4a07-9469-ba219727388b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:40.417153 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4ca34e7c-9641-4a07-9469-ba219727388b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:40.417654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4ca34e7c-9641-4a07-9469-ba219727388b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:40.418510 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4ca34e7c-9641-4a07-9469-ba219727388b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:40.418970 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4ca34e7c-9641-4a07-9469-ba219727388b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:40.419399 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4ca34e7c-9641-4a07-9469-ba219727388b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:40.497128 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4ca34e7c-9641-4a07-9469-ba219727388b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ea91bf04e741c793e4a06db9fb046f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e110109075848a89e6ae1d516de9784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:51:40.507974 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4ca34e7c-9641-4a07-9469-ba219727388b tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 200 len: 1306 microversion: 2.1 time: 0.103271 Aug 31 11:51:40.508676 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 500/999] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:40 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 1306 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:51:41.530025 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bbb8c1e3-a3e7-42d6-947d-108a9010b61d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:51:41.530926 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-bbb8c1e3-a3e7-42d6-947d-108a9010b61d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] [instance: 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:51:41.537795 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbb8c1e3-a3e7-42d6-947d-108a9010b61d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:41.538280 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbb8c1e3-a3e7-42d6-947d-108a9010b61d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:41.538718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbb8c1e3-a3e7-42d6-947d-108a9010b61d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:41.539412 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbb8c1e3-a3e7-42d6-947d-108a9010b61d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:51:41.539866 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbb8c1e3-a3e7-42d6-947d-108a9010b61d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:51:41.540293 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbb8c1e3-a3e7-42d6-947d-108a9010b61d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:51:41.554449 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-bbb8c1e3-a3e7-42d6-947d-108a9010b61d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] HTTP exception thrown: Instance 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab could not be found. Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bbb8c1e3-a3e7-42d6-947d-108a9010b61d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Request method failure captured: Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab HTTP/1.1 Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lTBYSI4Ellx1xSTrjGIoKiHgxhum85uyJe7v4p_7ezDgEUywOkeRvVgpwndDzyP6iljpAIyETuLAQabjcJl_KtU2r016DHL9lHZfhqzY9WRA62hsyCCf3I5xWBvvNZ5KLZHqUR5mR5wFwxzMbvDmChRreNmXS89FadI3ywt7qNUEw Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: 0e110109075848a89e6ae1d516de9784 Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2086882469 Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:51:41.556076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:51:41.557753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0e110109075848a89e6ae1d516de9784", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0e110109075848a89e6ae1d516de9784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e110109075848a89e6ae1d516de9784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0e110109075848a89e6ae1d516de9784"}]}] Aug 31 11:51:41.557753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2086882469 Aug 31 11:51:41.557753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: 0e110109075848a89e6ae1d516de9784 Aug 31 11:51:41.557753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2086882469 Aug 31 11:51:41.557753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-ServerRescueNegativeTestJSON-2086882469-project Aug 31 11:51:41.557753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:51:41.557753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:51:41.557753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 38ea91bf04e741c793e4a06db9fb046f Aug 31 11:51:41.557753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2086882469-project Aug 31 11:51:41.557753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:51:41.557753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab could not be found. Aug 31 11:51:41.557753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab'} Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab could not be found. Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:51:41.558640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab could not be found. Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab could not be found. Aug 31 11:51:41.560074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:51:41.562188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bbb8c1e3-a3e7-42d6-947d-108a9010b61d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] Returning 404 to user: Instance 5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:51:41.562188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-bbb8c1e3-a3e7-42d6-947d-108a9010b61d tempest-ServerRescueNegativeTestJSON-2086882469 tempest-ServerRescueNegativeTestJSON-2086882469-project] 10.222.0.60 "GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab" status: 404 len: 111 microversion: 2.1 time: 0.032053 Aug 31 11:51:41.562188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 500/1000] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:51:41 2022] GET /compute/v2.1/servers/5d03b1e8-faf7-44eb-a3f5-c99c0c9a7fab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:52:09.009936 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-960a4c1a-57f9-4c90-bd29-9fb63748f570 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:09.010578 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-960a4c1a-57f9-4c90-bd29-9fb63748f570 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:09.013955 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:09.014614 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:09.018744 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-960a4c1a-57f9-4c90-bd29-9fb63748f570 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:09.019227 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-960a4c1a-57f9-4c90-bd29-9fb63748f570 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:09.019661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-960a4c1a-57f9-4c90-bd29-9fb63748f570 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:09.020364 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-960a4c1a-57f9-4c90-bd29-9fb63748f570 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:09.020848 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-960a4c1a-57f9-4c90-bd29-9fb63748f570 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:09.021274 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-960a4c1a-57f9-4c90-bd29-9fb63748f570 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:09.050469 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-960a4c1a-57f9-4c90-bd29-9fb63748f570 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7/ips" status: 200 len: 153 microversion: 2.20 time: 0.045046 Aug 31 11:52:09.051042 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 501/1001] 10.222.0.60 () {60 vars in 1289 bytes} [Wed Aug 31 11:52:09 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7/ips => generated 153 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:52:10.781580 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-772739eb-f42a-4283-8b67-3a2adff49c80 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:10.782181 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-772739eb-f42a-4283-8b67-3a2adff49c80 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:10.784292 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=5 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:10.784955 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:10.793342 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-772739eb-f42a-4283-8b67-3a2adff49c80 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:10.793826 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-772739eb-f42a-4283-8b67-3a2adff49c80 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:10.794267 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-772739eb-f42a-4283-8b67-3a2adff49c80 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:10.795556 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-772739eb-f42a-4283-8b67-3a2adff49c80 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:10.796031 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-772739eb-f42a-4283-8b67-3a2adff49c80 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:10.796506 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-772739eb-f42a-4283-8b67-3a2adff49c80 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:10.822135 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-772739eb-f42a-4283-8b67-3a2adff49c80 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda/ips" status: 200 len: 149 microversion: 2.1 time: 0.045008 Aug 31 11:52:10.822745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 501/1002] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 31 11:52:10 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:52:10.914159 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d6abdb5b-5c98-4655-95be-17059e091a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:10.914727 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d6abdb5b-5c98-4655-95be-17059e091a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:10.922775 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6abdb5b-5c98-4655-95be-17059e091a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:10.923263 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6abdb5b-5c98-4655-95be-17059e091a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:10.923892 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6abdb5b-5c98-4655-95be-17059e091a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:10.924632 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6abdb5b-5c98-4655-95be-17059e091a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:10.925126 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6abdb5b-5c98-4655-95be-17059e091a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:10.925550 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d6abdb5b-5c98-4655-95be-17059e091a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:10.951930 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.objects.instance [None req-d6abdb5b-5c98-4655-95be-17059e091a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lazy-loading 'flavor' on Instance uuid 06aad3ea-8a4f-44c5-829c-b0230807fdf7 {{(pid=127062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:52:11.205359 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d6abdb5b-5c98-4655-95be-17059e091a81 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "POST /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7/action" status: 202 len: 0 microversion: 2.20 time: 0.295307 Aug 31 11:52:11.206582 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 502/1003] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Aug 31 11:52:10 2022] POST /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:52:11.215766 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2e8dd2ec-7b53-403b-9924-0c338914028c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:11.217504 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2e8dd2ec-7b53-403b-9924-0c338914028c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:11.225672 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2e8dd2ec-7b53-403b-9924-0c338914028c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:11.226298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2e8dd2ec-7b53-403b-9924-0c338914028c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:11.226742 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2e8dd2ec-7b53-403b-9924-0c338914028c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:11.227551 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2e8dd2ec-7b53-403b-9924-0c338914028c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:11.228078 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2e8dd2ec-7b53-403b-9924-0c338914028c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:11.228549 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2e8dd2ec-7b53-403b-9924-0c338914028c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:11.382408 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2e8dd2ec-7b53-403b-9924-0c338914028c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:11.390982 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2e8dd2ec-7b53-403b-9924-0c338914028c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:11.392422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2e8dd2ec-7b53-403b-9924-0c338914028c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:11.393635 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2e8dd2ec-7b53-403b-9924-0c338914028c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.182829 Aug 31 11:52:11.394187 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 502/1004] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:11 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:12.291535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8d544d28-a62e-4618-a5e8-26688fada673 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e84e7282-fa6c-41aa-b3ef-9e54d4e05fc8"}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:12.294146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8d544d28-a62e-4618-a5e8-26688fada673 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:12.301846 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8d544d28-a62e-4618-a5e8-26688fada673 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:12.302348 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8d544d28-a62e-4618-a5e8-26688fada673 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:12.302965 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8d544d28-a62e-4618-a5e8-26688fada673 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:12.303802 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8d544d28-a62e-4618-a5e8-26688fada673 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:12.304249 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8d544d28-a62e-4618-a5e8-26688fada673 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:12.304691 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8d544d28-a62e-4618-a5e8-26688fada673 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:12.418139 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d13495fd-f376-42d6-9ce7-1b88d7fa09df tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:12.419004 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d13495fd-f376-42d6-9ce7-1b88d7fa09df tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:12.427385 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d13495fd-f376-42d6-9ce7-1b88d7fa09df tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:12.428072 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d13495fd-f376-42d6-9ce7-1b88d7fa09df tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:12.428767 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d13495fd-f376-42d6-9ce7-1b88d7fa09df tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:12.429769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d13495fd-f376-42d6-9ce7-1b88d7fa09df tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:12.430613 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d13495fd-f376-42d6-9ce7-1b88d7fa09df tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:12.431199 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d13495fd-f376-42d6-9ce7-1b88d7fa09df tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:12.598835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d13495fd-f376-42d6-9ce7-1b88d7fa09df tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:12.599898 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8d544d28-a62e-4618-a5e8-26688fada673 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "POST /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314066 Aug 31 11:52:12.600891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 503/1005] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 31 11:52:12 2022] POST /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:52:12.615048 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d13495fd-f376-42d6-9ce7-1b88d7fa09df tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:12.617272 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d13495fd-f376-42d6-9ce7-1b88d7fa09df tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:12.618850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d13495fd-f376-42d6-9ce7-1b88d7fa09df tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.205431 Aug 31 11:52:12.619659 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 503/1006] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:12 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:13.648003 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c8e7a115-731d-4a5c-97ff-b00c158b465a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:13.648735 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c8e7a115-731d-4a5c-97ff-b00c158b465a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:13.656433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c8e7a115-731d-4a5c-97ff-b00c158b465a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:13.656960 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c8e7a115-731d-4a5c-97ff-b00c158b465a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:13.657398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c8e7a115-731d-4a5c-97ff-b00c158b465a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:13.658111 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c8e7a115-731d-4a5c-97ff-b00c158b465a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:13.658564 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c8e7a115-731d-4a5c-97ff-b00c158b465a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:13.658991 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c8e7a115-731d-4a5c-97ff-b00c158b465a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:13.842232 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c8e7a115-731d-4a5c-97ff-b00c158b465a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:13.850843 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c8e7a115-731d-4a5c-97ff-b00c158b465a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:13.852303 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c8e7a115-731d-4a5c-97ff-b00c158b465a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:13.853552 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c8e7a115-731d-4a5c-97ff-b00c158b465a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.210049 Aug 31 11:52:13.854128 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 504/1007] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:13 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:14.877827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4428a2e9-c889-45d9-bf44-bc3d2eaaa77c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:14.878436 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4428a2e9-c889-45d9-bf44-bc3d2eaaa77c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:14.885470 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4428a2e9-c889-45d9-bf44-bc3d2eaaa77c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:14.885976 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4428a2e9-c889-45d9-bf44-bc3d2eaaa77c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:14.886406 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4428a2e9-c889-45d9-bf44-bc3d2eaaa77c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:14.887099 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4428a2e9-c889-45d9-bf44-bc3d2eaaa77c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:14.887579 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4428a2e9-c889-45d9-bf44-bc3d2eaaa77c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:14.888761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4428a2e9-c889-45d9-bf44-bc3d2eaaa77c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:15.038670 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4428a2e9-c889-45d9-bf44-bc3d2eaaa77c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:15.048670 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4428a2e9-c889-45d9-bf44-bc3d2eaaa77c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:15.050573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4428a2e9-c889-45d9-bf44-bc3d2eaaa77c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:15.051883 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4428a2e9-c889-45d9-bf44-bc3d2eaaa77c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.178348 Aug 31 11:52:15.052518 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 504/1008] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:14 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:16.075614 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9d3b543a-4fba-4aec-a0d3-a68011c259ce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:16.076814 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9d3b543a-4fba-4aec-a0d3-a68011c259ce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:16.083460 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9d3b543a-4fba-4aec-a0d3-a68011c259ce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:16.083948 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9d3b543a-4fba-4aec-a0d3-a68011c259ce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:16.084411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9d3b543a-4fba-4aec-a0d3-a68011c259ce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:16.085130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9d3b543a-4fba-4aec-a0d3-a68011c259ce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:16.085582 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9d3b543a-4fba-4aec-a0d3-a68011c259ce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:16.086007 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9d3b543a-4fba-4aec-a0d3-a68011c259ce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:16.245947 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9d3b543a-4fba-4aec-a0d3-a68011c259ce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:16.255053 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9d3b543a-4fba-4aec-a0d3-a68011c259ce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:16.256773 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9d3b543a-4fba-4aec-a0d3-a68011c259ce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:16.257955 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9d3b543a-4fba-4aec-a0d3-a68011c259ce tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.186291 Aug 31 11:52:16.258520 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 505/1009] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:16 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:17.284164 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d34c7388-7cbb-4993-b05e-7533bb2784a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:17.284831 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d34c7388-7cbb-4993-b05e-7533bb2784a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:17.290959 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d34c7388-7cbb-4993-b05e-7533bb2784a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:17.291441 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d34c7388-7cbb-4993-b05e-7533bb2784a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:17.291880 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d34c7388-7cbb-4993-b05e-7533bb2784a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:17.292630 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d34c7388-7cbb-4993-b05e-7533bb2784a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:17.293089 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d34c7388-7cbb-4993-b05e-7533bb2784a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:17.293517 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d34c7388-7cbb-4993-b05e-7533bb2784a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:17.446466 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d34c7388-7cbb-4993-b05e-7533bb2784a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:17.457803 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d34c7388-7cbb-4993-b05e-7533bb2784a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:17.459362 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d34c7388-7cbb-4993-b05e-7533bb2784a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:17.460620 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d34c7388-7cbb-4993-b05e-7533bb2784a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.180445 Aug 31 11:52:17.461238 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 505/1010] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:17 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:18.485802 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0b8743ee-33e9-4914-b15c-0d0cb0788f1c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:18.486446 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0b8743ee-33e9-4914-b15c-0d0cb0788f1c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:18.493472 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b8743ee-33e9-4914-b15c-0d0cb0788f1c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:18.493998 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b8743ee-33e9-4914-b15c-0d0cb0788f1c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:18.494434 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b8743ee-33e9-4914-b15c-0d0cb0788f1c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:18.495144 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b8743ee-33e9-4914-b15c-0d0cb0788f1c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:18.495604 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b8743ee-33e9-4914-b15c-0d0cb0788f1c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:18.496052 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0b8743ee-33e9-4914-b15c-0d0cb0788f1c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:18.640422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0b8743ee-33e9-4914-b15c-0d0cb0788f1c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:18.648660 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0b8743ee-33e9-4914-b15c-0d0cb0788f1c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:18.650100 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0b8743ee-33e9-4914-b15c-0d0cb0788f1c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:18.651256 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0b8743ee-33e9-4914-b15c-0d0cb0788f1c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.170326 Aug 31 11:52:18.651814 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 506/1011] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:18 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:52:19.690514 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a1c1d776-bee8-4307-ac2d-6543fa65ead5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:19.691129 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a1c1d776-bee8-4307-ac2d-6543fa65ead5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:19.698186 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1c1d776-bee8-4307-ac2d-6543fa65ead5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:19.698662 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1c1d776-bee8-4307-ac2d-6543fa65ead5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:19.699090 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1c1d776-bee8-4307-ac2d-6543fa65ead5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:19.699780 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1c1d776-bee8-4307-ac2d-6543fa65ead5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:19.700223 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1c1d776-bee8-4307-ac2d-6543fa65ead5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:19.700685 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a1c1d776-bee8-4307-ac2d-6543fa65ead5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:19.848986 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a1c1d776-bee8-4307-ac2d-6543fa65ead5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:19.859323 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a1c1d776-bee8-4307-ac2d-6543fa65ead5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:19.861083 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a1c1d776-bee8-4307-ac2d-6543fa65ead5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:19.862391 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a1c1d776-bee8-4307-ac2d-6543fa65ead5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.190485 Aug 31 11:52:19.863013 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 506/1012] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:19 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:20.252958 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e645be10-68d9-49c7-a933-1650dccd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e84e7282-fa6c-41aa-b3ef-9e54d4e05fc8"}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:20.255392 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e645be10-68d9-49c7-a933-1650dccd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:20.262143 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e645be10-68d9-49c7-a933-1650dccd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:20.262623 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e645be10-68d9-49c7-a933-1650dccd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:20.263045 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e645be10-68d9-49c7-a933-1650dccd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:20.264793 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e645be10-68d9-49c7-a933-1650dccd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:20.265246 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e645be10-68d9-49c7-a933-1650dccd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:20.265663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e645be10-68d9-49c7-a933-1650dccd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:20.352341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-e645be10-68d9-49c7-a933-1650dccd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] HTTP exception thrown: Invalid volume: volume e84e7282-fa6c-41aa-b3ef-9e54d4e05fc8 is already attached to instances: 95a8e93a-cf62-4e41-98c8-a824827b2fda Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e645be10-68d9-49c7-a933-1650dccd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Request method failure captured: Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: POST /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda/os-volume_attachments HTTP/1.1 Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 74 Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lNZK36WRJOqsZNJl20dtBROIhvCChjxxXw9hostbElDCeoQYmhRnMS-kPydTDnhED92nvTRK2Z-mbhSicQnNG72V_XHtUyBJEP0Dy5LBQs28qt-qUXpO9451h3L1SwnxBkofz4240mv6LO2saJFZwry8omihvYKRxBlQ5VwAkEiuA Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:52:20.354110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:52:20.355836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4ac4dc41f7e420d811483990e020f22", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}] Aug 31 11:52:20.355836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:52:20.355836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:52:20.355836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:52:20.355836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:52:20.355836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:52:20.355836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:52:20.355836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 5de832888ffd4a69ae88cac6b632304e Aug 31 11:52:20.355836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:52:20.355836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Aug 31 11:52:20.355836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {"volumeAttachment": {"volumeId": "e84e7282-fa6c-41aa-b3ef-9e54d4e05fc8"}} Aug 31 11:52:20.355836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Invalid volume: volume e84e7282-fa6c-41aa-b3ef-9e54d4e05fc8 is already attached to instances: 95a8e93a-cf62-4e41-98c8-a824827b2fda Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'server_id': '95a8e93a-cf62-4e41-98c8-a824827b2fda', 'body': {'volumeAttachment': {'volumeId': 'e84e7282-fa6c-41aa-b3ef-9e54d4e05fc8'}}} Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e84e7282-fa6c-41aa-b3ef-9e54d4e05fc8 is already attached to instances: 95a8e93a-cf62-4e41-98c8-a824827b2fda Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:52:20.356797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e84e7282-fa6c-41aa-b3ef-9e54d4e05fc8 is already attached to instances: 95a8e93a-cf62-4e41-98c8-a824827b2fda Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:52:20.358293 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:52:20.359843 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:52:20.359843 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:52:20.359843 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:52:20.359843 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e84e7282-fa6c-41aa-b3ef-9e54d4e05fc8 is already attached to instances: 95a8e93a-cf62-4e41-98c8-a824827b2fda Aug 31 11:52:20.359843 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:52:20.359843 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e645be10-68d9-49c7-a933-1650dccd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Returning 400 to user: Invalid volume: volume e84e7282-fa6c-41aa-b3ef-9e54d4e05fc8 is already attached to instances: 95a8e93a-cf62-4e41-98c8-a824827b2fda {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:52:20.359843 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e645be10-68d9-49c7-a933-1650dccd4efd tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "POST /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106611 Aug 31 11:52:20.359843 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 507/1013] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 31 11:52:20 2022] POST /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:52:20.424800 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fce3ade4-0512-4c9a-9664-b4872911f64c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:20.425318 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fce3ade4-0512-4c9a-9664-b4872911f64c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:20.431668 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fce3ade4-0512-4c9a-9664-b4872911f64c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:20.432152 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fce3ade4-0512-4c9a-9664-b4872911f64c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:20.432706 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fce3ade4-0512-4c9a-9664-b4872911f64c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:20.433435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fce3ade4-0512-4c9a-9664-b4872911f64c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:20.433927 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fce3ade4-0512-4c9a-9664-b4872911f64c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:20.434367 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fce3ade4-0512-4c9a-9664-b4872911f64c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:20.527772 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-fce3ade4-0512-4c9a-9664-b4872911f64c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lazy-loading 'services' on Instance uuid 95a8e93a-cf62-4e41-98c8-a824827b2fda {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:52:20.607860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-fce3ade4-0512-4c9a-9664-b4872911f64c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "DELETE /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda/os-volume_attachments/e84e7282-fa6c-41aa-b3ef-9e54d4e05fc8" status: 202 len: 0 microversion: 2.1 time: 0.187055 Aug 31 11:52:20.608466 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 507/1014] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 31 11:52:20 2022] DELETE /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda/os-volume_attachments/e84e7282-fa6c-41aa-b3ef-9e54d4e05fc8 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:52:20.617527 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-82d475e6-75ea-4473-9590-36d3028d357c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:20.620051 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-82d475e6-75ea-4473-9590-36d3028d357c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:20.634498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-82d475e6-75ea-4473-9590-36d3028d357c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:20.635260 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-82d475e6-75ea-4473-9590-36d3028d357c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:20.635920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-82d475e6-75ea-4473-9590-36d3028d357c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:20.637472 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-82d475e6-75ea-4473-9590-36d3028d357c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:20.638929 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-82d475e6-75ea-4473-9590-36d3028d357c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:20.639509 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-82d475e6-75ea-4473-9590-36d3028d357c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:20.691275 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-82d475e6-75ea-4473-9590-36d3028d357c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078046 Aug 31 11:52:20.691773 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 508/1015] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:52:20 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:52:20.888807 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9bee87c3-6e91-406d-a588-3aa9b0fc775d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:20.889720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9bee87c3-6e91-406d-a588-3aa9b0fc775d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:20.897383 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bee87c3-6e91-406d-a588-3aa9b0fc775d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:20.897955 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bee87c3-6e91-406d-a588-3aa9b0fc775d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:20.898453 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bee87c3-6e91-406d-a588-3aa9b0fc775d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:20.899294 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bee87c3-6e91-406d-a588-3aa9b0fc775d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:20.899792 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bee87c3-6e91-406d-a588-3aa9b0fc775d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:20.900302 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bee87c3-6e91-406d-a588-3aa9b0fc775d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:21.038407 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9bee87c3-6e91-406d-a588-3aa9b0fc775d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:21.049113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9bee87c3-6e91-406d-a588-3aa9b0fc775d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:21.050944 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9bee87c3-6e91-406d-a588-3aa9b0fc775d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:21.052389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9bee87c3-6e91-406d-a588-3aa9b0fc775d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.169382 Aug 31 11:52:21.053088 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 508/1016] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:20 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:21.705845 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cf67ed2e-039a-4cc6-83c3-16d895eb7620 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:21.708212 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cf67ed2e-039a-4cc6-83c3-16d895eb7620 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:21.715789 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf67ed2e-039a-4cc6-83c3-16d895eb7620 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:21.717582 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf67ed2e-039a-4cc6-83c3-16d895eb7620 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:21.718112 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf67ed2e-039a-4cc6-83c3-16d895eb7620 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:21.719015 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf67ed2e-039a-4cc6-83c3-16d895eb7620 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:21.719537 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf67ed2e-039a-4cc6-83c3-16d895eb7620 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:21.720031 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf67ed2e-039a-4cc6-83c3-16d895eb7620 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:21.751865 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cf67ed2e-039a-4cc6-83c3-16d895eb7620 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050030 Aug 31 11:52:21.752454 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 509/1017] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:52:21 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:52:21.836848 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1e327721-5750-4b83-8c88-4cde5a6d5fd7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:21.837522 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1e327721-5750-4b83-8c88-4cde5a6d5fd7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:21.844029 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1e327721-5750-4b83-8c88-4cde5a6d5fd7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:21.844791 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1e327721-5750-4b83-8c88-4cde5a6d5fd7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:21.845225 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1e327721-5750-4b83-8c88-4cde5a6d5fd7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:21.845938 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1e327721-5750-4b83-8c88-4cde5a6d5fd7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:21.846393 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1e327721-5750-4b83-8c88-4cde5a6d5fd7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:21.846822 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1e327721-5750-4b83-8c88-4cde5a6d5fd7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:21.875223 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1e327721-5750-4b83-8c88-4cde5a6d5fd7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Going to try to terminate instance {{(pid=127061) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:52:21.964004 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1e327721-5750-4b83-8c88-4cde5a6d5fd7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "DELETE /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 204 len: 0 microversion: 2.1 time: 0.130697 Aug 31 11:52:21.965154 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 509/1018] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:52:21 2022] DELETE /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:52:21.974135 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e47335aa-7dfc-4178-9329-dbcf999a501c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:21.974776 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e47335aa-7dfc-4178-9329-dbcf999a501c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:21.980827 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e47335aa-7dfc-4178-9329-dbcf999a501c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:21.981347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e47335aa-7dfc-4178-9329-dbcf999a501c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:21.981831 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e47335aa-7dfc-4178-9329-dbcf999a501c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:21.982590 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e47335aa-7dfc-4178-9329-dbcf999a501c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:21.983061 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e47335aa-7dfc-4178-9329-dbcf999a501c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:21.983502 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e47335aa-7dfc-4178-9329-dbcf999a501c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:22.080705 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d0a648d7-d98b-49d8-888b-d9c36f9f08e4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:22.081675 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d0a648d7-d98b-49d8-888b-d9c36f9f08e4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:22.088681 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0a648d7-d98b-49d8-888b-d9c36f9f08e4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:22.089231 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0a648d7-d98b-49d8-888b-d9c36f9f08e4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:22.089880 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0a648d7-d98b-49d8-888b-d9c36f9f08e4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:22.090668 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0a648d7-d98b-49d8-888b-d9c36f9f08e4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:22.091204 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0a648d7-d98b-49d8-888b-d9c36f9f08e4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:22.091955 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d0a648d7-d98b-49d8-888b-d9c36f9f08e4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:22.137499 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e47335aa-7dfc-4178-9329-dbcf999a501c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:22.146851 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e47335aa-7dfc-4178-9329-dbcf999a501c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1680 microversion: 2.1 time: 0.176713 Aug 31 11:52:22.160520 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 510/1019] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:21 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:22.246951 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d0a648d7-d98b-49d8-888b-d9c36f9f08e4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:22.258197 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d0a648d7-d98b-49d8-888b-d9c36f9f08e4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:22.259818 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d0a648d7-d98b-49d8-888b-d9c36f9f08e4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:22.261137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d0a648d7-d98b-49d8-888b-d9c36f9f08e4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.185683 Aug 31 11:52:22.261852 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 510/1020] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:22 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:52:23.169724 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b99a02a0-f150-4dd3-b9e2-d3fea99f7c12 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:23.170803 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b99a02a0-f150-4dd3-b9e2-d3fea99f7c12 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:23.177543 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b99a02a0-f150-4dd3-b9e2-d3fea99f7c12 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:23.178027 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b99a02a0-f150-4dd3-b9e2-d3fea99f7c12 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:23.178462 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b99a02a0-f150-4dd3-b9e2-d3fea99f7c12 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:23.179173 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b99a02a0-f150-4dd3-b9e2-d3fea99f7c12 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:23.179630 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b99a02a0-f150-4dd3-b9e2-d3fea99f7c12 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:23.180060 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b99a02a0-f150-4dd3-b9e2-d3fea99f7c12 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:23.287221 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d948b754-12a0-409b-9b56-61416dc23756 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:23.288465 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d948b754-12a0-409b-9b56-61416dc23756 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:23.295982 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d948b754-12a0-409b-9b56-61416dc23756 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:23.296840 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d948b754-12a0-409b-9b56-61416dc23756 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:23.297496 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d948b754-12a0-409b-9b56-61416dc23756 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:23.309478 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d948b754-12a0-409b-9b56-61416dc23756 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:23.312434 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d948b754-12a0-409b-9b56-61416dc23756 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:23.312955 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d948b754-12a0-409b-9b56-61416dc23756 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:23.345042 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b99a02a0-f150-4dd3-b9e2-d3fea99f7c12 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:23.354777 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b99a02a0-f150-4dd3-b9e2-d3fea99f7c12 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1680 microversion: 2.1 time: 0.189234 Aug 31 11:52:23.355656 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 511/1021] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:23 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:23.532941 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d948b754-12a0-409b-9b56-61416dc23756 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:23.541436 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d948b754-12a0-409b-9b56-61416dc23756 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:23.543061 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d948b754-12a0-409b-9b56-61416dc23756 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:23.544367 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d948b754-12a0-409b-9b56-61416dc23756 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.261858 Aug 31 11:52:23.556705 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 511/1022] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:23 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:52:24.389695 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-35c3bb4d-2d20-4817-8ecb-972280671f20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:24.391134 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-35c3bb4d-2d20-4817-8ecb-972280671f20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:24.399099 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35c3bb4d-2d20-4817-8ecb-972280671f20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:24.399705 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35c3bb4d-2d20-4817-8ecb-972280671f20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:24.400551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35c3bb4d-2d20-4817-8ecb-972280671f20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:24.401580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35c3bb4d-2d20-4817-8ecb-972280671f20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:24.402211 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35c3bb4d-2d20-4817-8ecb-972280671f20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:24.402824 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-35c3bb4d-2d20-4817-8ecb-972280671f20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:24.575059 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-21deadc7-053b-4797-8b2d-e52b93986f0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:24.576013 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-21deadc7-053b-4797-8b2d-e52b93986f0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:24.586974 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21deadc7-053b-4797-8b2d-e52b93986f0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:24.587849 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21deadc7-053b-4797-8b2d-e52b93986f0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:24.593727 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-35c3bb4d-2d20-4817-8ecb-972280671f20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:24.597215 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21deadc7-053b-4797-8b2d-e52b93986f0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:24.598828 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21deadc7-053b-4797-8b2d-e52b93986f0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:24.599942 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21deadc7-053b-4797-8b2d-e52b93986f0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:24.601096 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-21deadc7-053b-4797-8b2d-e52b93986f0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:24.608422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-35c3bb4d-2d20-4817-8ecb-972280671f20 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1680 microversion: 2.1 time: 0.227086 Aug 31 11:52:24.611172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 512/1023] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:24 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1680 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:24.833787 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-21deadc7-053b-4797-8b2d-e52b93986f0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:24.843406 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-21deadc7-053b-4797-8b2d-e52b93986f0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:24.844888 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-21deadc7-053b-4797-8b2d-e52b93986f0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:24.846088 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-21deadc7-053b-4797-8b2d-e52b93986f0d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.278655 Aug 31 11:52:24.846815 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 512/1024] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:24 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:24.978544 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-732bbde2-80a5-4d3b-bd1b-af74e974583f req-19c94fb3-70f4-43a9-842a-99b6d1505743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a8e93a-cf62-4e41-98c8-a824827b2fda", "name": "network-vif-deleted", "tag": "34bf57b1-b383-42f7-8724-12e4424e5e56"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:25.006768 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-732bbde2-80a5-4d3b-bd1b-af74e974583f req-19c94fb3-70f4-43a9-842a-99b6d1505743 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:25.007312 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-732bbde2-80a5-4d3b-bd1b-af74e974583f req-19c94fb3-70f4-43a9-842a-99b6d1505743 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:25.007748 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-732bbde2-80a5-4d3b-bd1b-af74e974583f req-19c94fb3-70f4-43a9-842a-99b6d1505743 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:25.037297 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-732bbde2-80a5-4d3b-bd1b-af74e974583f req-19c94fb3-70f4-43a9-842a-99b6d1505743 service nova] Creating event network-vif-deleted:34bf57b1-b383-42f7-8724-12e4424e5e56 for instance 95a8e93a-cf62-4e41-98c8-a824827b2fda on hv-cinder-83976 Aug 31 11:52:25.047645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-732bbde2-80a5-4d3b-bd1b-af74e974583f req-19c94fb3-70f4-43a9-842a-99b6d1505743 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073162 Aug 31 11:52:25.067797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 513/1025] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:52:25.632995 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1809b4c5-87b0-4e40-bf4b-da259aecfb73 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:25.633849 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1809b4c5-87b0-4e40-bf4b-da259aecfb73 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:25.644616 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1809b4c5-87b0-4e40-bf4b-da259aecfb73 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:25.646267 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1809b4c5-87b0-4e40-bf4b-da259aecfb73 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:25.647339 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1809b4c5-87b0-4e40-bf4b-da259aecfb73 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:25.649231 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1809b4c5-87b0-4e40-bf4b-da259aecfb73 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:25.650299 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1809b4c5-87b0-4e40-bf4b-da259aecfb73 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:25.651724 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1809b4c5-87b0-4e40-bf4b-da259aecfb73 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:25.704974 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1809b4c5-87b0-4e40-bf4b-da259aecfb73 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:25.705982 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1809b4c5-87b0-4e40-bf4b-da259aecfb73 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:25.706637 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1809b4c5-87b0-4e40-bf4b-da259aecfb73 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:25.707347 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-1809b4c5-87b0-4e40-bf4b-da259aecfb73 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lazy-loading 'fault' on Instance uuid 95a8e93a-cf62-4e41-98c8-a824827b2fda {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:52:25.781051 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1809b4c5-87b0-4e40-bf4b-da259aecfb73 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:25.794025 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1809b4c5-87b0-4e40-bf4b-da259aecfb73 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 200 len: 1331 microversion: 2.1 time: 0.164716 Aug 31 11:52:25.794273 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 513/1026] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:25 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 1331 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:25.876094 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9fc3a814-35a6-46c2-8967-d6c462ae1fda tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:25.877007 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9fc3a814-35a6-46c2-8967-d6c462ae1fda tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:25.885555 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fc3a814-35a6-46c2-8967-d6c462ae1fda tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:25.885866 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fc3a814-35a6-46c2-8967-d6c462ae1fda tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:25.886339 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fc3a814-35a6-46c2-8967-d6c462ae1fda tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:25.887164 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fc3a814-35a6-46c2-8967-d6c462ae1fda tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:25.887734 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fc3a814-35a6-46c2-8967-d6c462ae1fda tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:25.888876 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fc3a814-35a6-46c2-8967-d6c462ae1fda tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:26.132195 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9fc3a814-35a6-46c2-8967-d6c462ae1fda tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:26.143894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9fc3a814-35a6-46c2-8967-d6c462ae1fda tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:26.145387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9fc3a814-35a6-46c2-8967-d6c462ae1fda tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:26.146582 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9fc3a814-35a6-46c2-8967-d6c462ae1fda tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.281598 Aug 31 11:52:26.147144 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 514/1027] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:25 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:26.819450 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e91aa3cf-68e4-4448-ad06-a25365fa0641 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:26.820229 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e91aa3cf-68e4-4448-ad06-a25365fa0641 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:26.827949 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e91aa3cf-68e4-4448-ad06-a25365fa0641 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:26.828850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e91aa3cf-68e4-4448-ad06-a25365fa0641 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:26.829290 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e91aa3cf-68e4-4448-ad06-a25365fa0641 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:26.830011 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e91aa3cf-68e4-4448-ad06-a25365fa0641 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:26.830562 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e91aa3cf-68e4-4448-ad06-a25365fa0641 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:26.830991 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e91aa3cf-68e4-4448-ad06-a25365fa0641 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:26.848111 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-e91aa3cf-68e4-4448-ad06-a25365fa0641 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] HTTP exception thrown: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e91aa3cf-68e4-4448-ad06-a25365fa0641 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Request method failure captured: Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda HTTP/1.1 Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lNZK36WRJOqsZNJl20dtBROIhvCChjxxXw9hostbElDCeoQYmhRnMS-kPydTDnhED92nvTRK2Z-mbhSicQnNG72V_XHtUyBJEP0Dy5LBQs28qt-qUXpO9451h3L1SwnxBkofz4240mv6LO2saJFZwry8omihvYKRxBlQ5VwAkEiuA Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:52:26.849814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:52:26.851573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4ac4dc41f7e420d811483990e020f22", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}] Aug 31 11:52:26.851573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:52:26.851573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:52:26.851573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:52:26.851573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:52:26.851573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:52:26.851573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:52:26.851573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 5de832888ffd4a69ae88cac6b632304e Aug 31 11:52:26.851573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:52:26.851573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:52:26.851573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. Aug 31 11:52:26.851573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '95a8e93a-cf62-4e41-98c8-a824827b2fda'} Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:52:26.853100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. Aug 31 11:52:26.854667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:52:26.857177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e91aa3cf-68e4-4448-ad06-a25365fa0641 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Returning 404 to user: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:52:26.857177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e91aa3cf-68e4-4448-ad06-a25365fa0641 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 404 len: 111 microversion: 2.1 time: 0.036772 Aug 31 11:52:26.857177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 514/1028] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:26 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:52:26.861124 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cd01297b-6ca3-49df-a6e3-3cded1d7f28c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '.version_select at 0x7f17349a7040>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:26.881252 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cd01297b-6ca3-49df-a6e3-3cded1d7f28c tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-629039051" status: 202 len: 0 microversion: 2.1 time: 0.024640 Aug 31 11:52:26.882508 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 515/1029] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Aug 31 11:52:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-629039051 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:52:27.183158 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ade3d46d-e615-4b09-ad81-e4a98f665a3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:27.186847 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ade3d46d-e615-4b09-ad81-e4a98f665a3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:27.198580 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ade3d46d-e615-4b09-ad81-e4a98f665a3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:27.199499 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ade3d46d-e615-4b09-ad81-e4a98f665a3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:27.200157 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ade3d46d-e615-4b09-ad81-e4a98f665a3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:27.201817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ade3d46d-e615-4b09-ad81-e4a98f665a3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:27.202479 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ade3d46d-e615-4b09-ad81-e4a98f665a3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:27.203166 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ade3d46d-e615-4b09-ad81-e4a98f665a3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:27.373674 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ade3d46d-e615-4b09-ad81-e4a98f665a3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:27.377812 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:27.385588 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ade3d46d-e615-4b09-ad81-e4a98f665a3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:27.387039 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ade3d46d-e615-4b09-ad81-e4a98f665a3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:27.388965 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ade3d46d-e615-4b09-ad81-e4a98f665a3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.220519 Aug 31 11:52:27.389564 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 515/1030] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:27 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:52:27.695313 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ba6ea263-806f-4721-9098-74d8b93a5ed3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Action: 'create', calling method: .version_select at 0x7f1734a45430>, body: {"keypair": {"name": "tempest-keypair-1816970512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApiCmBSqw78KAJjMSEwGV21cv3EioC81KA9Y55JJ2Soz5aRkOV5vd5hBghEp8mO9vWsFp6Fb2xfY42NhSydVahKX2uwhkkBLfYJqzafXyY0sEzINv4INivu1tUgjoR32A=="}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:27.718129 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-ba6ea263-806f-4721-9098-74d8b93a5ed3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for project b4ac4dc41f7e420d811483990e020f22. Resources: {'key_pairs'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:52:27.722597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-ba6ea263-806f-4721-9098-74d8b93a5ed3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for user 5de832888ffd4a69ae88cac6b632304e and project b4ac4dc41f7e420d811483990e020f22. Resources: {'key_pairs'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:52:27.755959 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ba6ea263-806f-4721-9098-74d8b93a5ed3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066862 Aug 31 11:52:27.756836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 516/1031] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 31 11:52:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:52:28.350419 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-383243750", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "networks": [{"uuid": "184b7f94-1618-4f83-b503-001697392805"}]}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:28.416231 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-bd1cf938-0fef-43ea-8d98-b9254d39b726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:28.416231 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-bd1cf938-0fef-43ea-8d98-b9254d39b726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:28.427811 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.network.neutron [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] validate_networks() for [('184b7f94-1618-4f83-b503-001697392805', None, None, None, None, None)] {{(pid=127061) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:52:28.431085 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bd1cf938-0fef-43ea-8d98-b9254d39b726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:28.432078 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bd1cf938-0fef-43ea-8d98-b9254d39b726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:28.432868 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bd1cf938-0fef-43ea-8d98-b9254d39b726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:28.434094 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bd1cf938-0fef-43ea-8d98-b9254d39b726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:28.434593 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bd1cf938-0fef-43ea-8d98-b9254d39b726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:28.435425 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bd1cf938-0fef-43ea-8d98-b9254d39b726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:28.441138 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:28.594323 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-bd1cf938-0fef-43ea-8d98-b9254d39b726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:28.604555 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-bd1cf938-0fef-43ea-8d98-b9254d39b726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:28.606325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-bd1cf938-0fef-43ea-8d98-b9254d39b726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:28.608421 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-bd1cf938-0fef-43ea-8d98-b9254d39b726 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1746 microversion: 2.20 time: 0.198296 Aug 31 11:52:28.609147 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 517/1032] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:28 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1746 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:29.105816 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Flavor limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:52:29.106339 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Image limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:52:29.106996 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Flavor pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:52:29.107779 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Image pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:52:29.108299 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:52:29.121082 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:29.121770 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:29.122419 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:29.123475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:29.124022 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:29.124567 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:29.146008 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Getting quotas for project 2dbfe7ba453b472ba09b554b59d79281. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:52:29.150692 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Getting quotas for user ea03ffe5a78e4741a47aa8087db14053 and project 2dbfe7ba453b472ba09b554b59d79281. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:52:29.169715 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Going to run 1 instances... {{(pid=127061) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:52:29.172104 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127061) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:52:29.225986 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f0e2c307-3131-4f4c-bb73-2f4a0b0f4db6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882930 Aug 31 11:52:29.231227 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 516/1033] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:52:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 11:52:29.247204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f4720f64-3072-4e4a-8692-c90e88d10de2 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:29.249190 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f4720f64-3072-4e4a-8692-c90e88d10de2 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:29.313386 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f4720f64-3072-4e4a-8692-c90e88d10de2 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:29.322170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f4720f64-3072-4e4a-8692-c90e88d10de2 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 200 len: 1213 microversion: 2.1 time: 0.081897 Aug 31 11:52:29.332527 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 518/1034] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:29 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:29.642735 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2d87259c-9f4f-4fac-9a75-a6227e317a6b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:29.649532 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2d87259c-9f4f-4fac-9a75-a6227e317a6b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:29.659370 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d87259c-9f4f-4fac-9a75-a6227e317a6b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:29.660298 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d87259c-9f4f-4fac-9a75-a6227e317a6b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:29.661252 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d87259c-9f4f-4fac-9a75-a6227e317a6b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:29.662993 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d87259c-9f4f-4fac-9a75-a6227e317a6b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:29.663831 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d87259c-9f4f-4fac-9a75-a6227e317a6b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:29.664703 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d87259c-9f4f-4fac-9a75-a6227e317a6b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:29.747999 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1686156305", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5aa6b83-6517-47ce-979a-ff78821ec50d"}], "security_groups": [{"name": "tempest-securitygroup--1495495959"}], "key_name": "tempest-keypair-1816970512", "user_data": "}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:29.932028 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.network.neutron [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] validate_networks() for [('e5aa6b83-6517-47ce-979a-ff78821ec50d', None, None, None, None, None)] {{(pid=127062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:52:29.941686 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2d87259c-9f4f-4fac-9a75-a6227e317a6b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:29.952312 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2d87259c-9f4f-4fac-9a75-a6227e317a6b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:29.954411 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2d87259c-9f4f-4fac-9a75-a6227e317a6b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:29.956290 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2d87259c-9f4f-4fac-9a75-a6227e317a6b tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1746 microversion: 2.20 time: 0.322169 Aug 31 11:52:29.956992 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 517/1035] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:29 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1746 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:30.347611 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ca16f8c1-5256-48d6-a765-cc8922f80f2b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:30.348716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-ca16f8c1-5256-48d6-a765-cc8922f80f2b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:30.356437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca16f8c1-5256-48d6-a765-cc8922f80f2b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:30.357234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca16f8c1-5256-48d6-a765-cc8922f80f2b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:30.357750 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca16f8c1-5256-48d6-a765-cc8922f80f2b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:30.359004 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca16f8c1-5256-48d6-a765-cc8922f80f2b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:30.359824 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca16f8c1-5256-48d6-a765-cc8922f80f2b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:30.360709 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-ca16f8c1-5256-48d6-a765-cc8922f80f2b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:30.440552 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Flavor limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:52:30.441247 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Image limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:52:30.441943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Flavor pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:52:30.442516 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Image pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:52:30.443142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:52:30.455141 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:30.455825 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:30.456454 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:30.457585 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:30.458176 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:30.458647 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:30.467203 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-ca16f8c1-5256-48d6-a765-cc8922f80f2b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:30.477418 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ca16f8c1-5256-48d6-a765-cc8922f80f2b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 200 len: 1265 microversion: 2.1 time: 0.135773 Aug 31 11:52:30.478094 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 518/1036] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:30 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:52:30.479577 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for project b4ac4dc41f7e420d811483990e020f22. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:52:30.484934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Getting quotas for user 5de832888ffd4a69ae88cac6b632304e and project b4ac4dc41f7e420d811483990e020f22. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:52:30.504459 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Going to run 1 instances... {{(pid=127062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:52:30.506967 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:52:30.560307 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-40eca660-ca60-4a91-a6d2-1f6c3dd891d5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.817521 Aug 31 11:52:30.565745 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 519/1037] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:52:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:52:30.577128 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d8935b9b-4fcf-409f-ad49-2fc2521cbde8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:30.577902 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d8935b9b-4fcf-409f-ad49-2fc2521cbde8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:30.651236 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d8935b9b-4fcf-409f-ad49-2fc2521cbde8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:30.662032 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d8935b9b-4fcf-409f-ad49-2fc2521cbde8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1242 microversion: 2.1 time: 0.091872 Aug 31 11:52:30.663545 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 519/1038] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:30 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:52:30.983775 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ce7d8f95-87f9-4f67-9589-6e5db4cb0455 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:30.984403 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ce7d8f95-87f9-4f67-9589-6e5db4cb0455 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:30.991509 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ce7d8f95-87f9-4f67-9589-6e5db4cb0455 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:30.992004 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ce7d8f95-87f9-4f67-9589-6e5db4cb0455 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:30.992477 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ce7d8f95-87f9-4f67-9589-6e5db4cb0455 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:30.993223 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ce7d8f95-87f9-4f67-9589-6e5db4cb0455 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:30.993682 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ce7d8f95-87f9-4f67-9589-6e5db4cb0455 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:30.994119 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ce7d8f95-87f9-4f67-9589-6e5db4cb0455 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:31.177796 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ce7d8f95-87f9-4f67-9589-6e5db4cb0455 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:31.187503 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ce7d8f95-87f9-4f67-9589-6e5db4cb0455 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:31.189036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ce7d8f95-87f9-4f67-9589-6e5db4cb0455 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:31.190493 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ce7d8f95-87f9-4f67-9589-6e5db4cb0455 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1746 microversion: 2.20 time: 0.212313 Aug 31 11:52:31.193038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 520/1039] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:30 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1746 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:31.502824 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-41bae9e9-86dc-45db-82e7-b119ead0d211 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:31.503437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-41bae9e9-86dc-45db-82e7-b119ead0d211 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:31.510410 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-41bae9e9-86dc-45db-82e7-b119ead0d211 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:31.511168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-41bae9e9-86dc-45db-82e7-b119ead0d211 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:31.511790 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-41bae9e9-86dc-45db-82e7-b119ead0d211 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:31.512549 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-41bae9e9-86dc-45db-82e7-b119ead0d211 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:31.513624 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-41bae9e9-86dc-45db-82e7-b119ead0d211 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:31.514981 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-41bae9e9-86dc-45db-82e7-b119ead0d211 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:31.598392 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-240dddb8-b0de-45b4-a2b9-94fee865a56e req-82ea7e33-85d5-4ae7-9e7a-c138d7ba0465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06aad3ea-8a4f-44c5-829c-b0230807fdf7", "name": "network-vif-plugged", "status": "completed", "tag": "936e8033-671c-4a3d-9abe-a63045a10877"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:31.606241 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-41bae9e9-86dc-45db-82e7-b119ead0d211 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:31.622826 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-41bae9e9-86dc-45db-82e7-b119ead0d211 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 200 len: 1271 microversion: 2.1 time: 0.124394 Aug 31 11:52:31.624353 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 520/1040] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:31 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 1271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:52:31.637484 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-240dddb8-b0de-45b4-a2b9-94fee865a56e req-82ea7e33-85d5-4ae7-9e7a-c138d7ba0465 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:31.637484 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-240dddb8-b0de-45b4-a2b9-94fee865a56e req-82ea7e33-85d5-4ae7-9e7a-c138d7ba0465 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:31.637484 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-240dddb8-b0de-45b4-a2b9-94fee865a56e req-82ea7e33-85d5-4ae7-9e7a-c138d7ba0465 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:31.653079 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-240dddb8-b0de-45b4-a2b9-94fee865a56e req-82ea7e33-85d5-4ae7-9e7a-c138d7ba0465 service nova] Creating event network-vif-plugged:936e8033-671c-4a3d-9abe-a63045a10877 for instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 on hv-cinder-83976 Aug 31 11:52:31.659471 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-240dddb8-b0de-45b4-a2b9-94fee865a56e req-82ea7e33-85d5-4ae7-9e7a-c138d7ba0465 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066685 Aug 31 11:52:31.660276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 521/1041] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:52:31.691504 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f6acd3d1-ae9c-446a-afde-5ee048dd93c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:31.693169 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f6acd3d1-ae9c-446a-afde-5ee048dd93c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:31.710460 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f6acd3d1-ae9c-446a-afde-5ee048dd93c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:31.711620 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f6acd3d1-ae9c-446a-afde-5ee048dd93c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:31.712761 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f6acd3d1-ae9c-446a-afde-5ee048dd93c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:31.713925 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f6acd3d1-ae9c-446a-afde-5ee048dd93c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:31.715201 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f6acd3d1-ae9c-446a-afde-5ee048dd93c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:31.715852 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f6acd3d1-ae9c-446a-afde-5ee048dd93c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:31.811744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f6acd3d1-ae9c-446a-afde-5ee048dd93c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:31.827023 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f6acd3d1-ae9c-446a-afde-5ee048dd93c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1294 microversion: 2.1 time: 0.139820 Aug 31 11:52:31.828088 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 521/1042] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:31 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1294 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:52:32.219494 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8be6948d-9e5f-411e-88ca-380de4026ff4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:32.221057 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8be6948d-9e5f-411e-88ca-380de4026ff4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:32.233265 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8be6948d-9e5f-411e-88ca-380de4026ff4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:32.234290 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8be6948d-9e5f-411e-88ca-380de4026ff4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:32.235241 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8be6948d-9e5f-411e-88ca-380de4026ff4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:32.236423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8be6948d-9e5f-411e-88ca-380de4026ff4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:32.237112 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8be6948d-9e5f-411e-88ca-380de4026ff4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:32.237699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8be6948d-9e5f-411e-88ca-380de4026ff4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:32.504229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8be6948d-9e5f-411e-88ca-380de4026ff4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:32.516072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8be6948d-9e5f-411e-88ca-380de4026ff4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:32.518406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8be6948d-9e5f-411e-88ca-380de4026ff4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:32.520320 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8be6948d-9e5f-411e-88ca-380de4026ff4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1746 microversion: 2.20 time: 0.307359 Aug 31 11:52:32.521374 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 522/1043] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:32 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1746 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:32.648922 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9bf5ddc1-fed2-4384-977f-39a2eda31ea6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:32.650045 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9bf5ddc1-fed2-4384-977f-39a2eda31ea6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:32.658858 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bf5ddc1-fed2-4384-977f-39a2eda31ea6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:32.659347 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bf5ddc1-fed2-4384-977f-39a2eda31ea6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:32.660374 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bf5ddc1-fed2-4384-977f-39a2eda31ea6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:32.661191 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bf5ddc1-fed2-4384-977f-39a2eda31ea6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:32.661642 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bf5ddc1-fed2-4384-977f-39a2eda31ea6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:32.662272 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bf5ddc1-fed2-4384-977f-39a2eda31ea6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:32.852434 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cf87fb5e-d582-4a2a-aea8-5bc2f450c1d2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:32.853607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cf87fb5e-d582-4a2a-aea8-5bc2f450c1d2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:32.862686 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf87fb5e-d582-4a2a-aea8-5bc2f450c1d2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:32.863707 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf87fb5e-d582-4a2a-aea8-5bc2f450c1d2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:32.864737 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf87fb5e-d582-4a2a-aea8-5bc2f450c1d2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:32.865841 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf87fb5e-d582-4a2a-aea8-5bc2f450c1d2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:32.866704 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf87fb5e-d582-4a2a-aea8-5bc2f450c1d2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:32.867276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cf87fb5e-d582-4a2a-aea8-5bc2f450c1d2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:32.936543 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9bf5ddc1-fed2-4384-977f-39a2eda31ea6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:32.953424 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9bf5ddc1-fed2-4384-977f-39a2eda31ea6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 200 len: 1313 microversion: 2.1 time: 0.311012 Aug 31 11:52:32.954325 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 522/1044] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:32 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:32.982563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cf87fb5e-d582-4a2a-aea8-5bc2f450c1d2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:32.993217 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cf87fb5e-d582-4a2a-aea8-5bc2f450c1d2 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1300 microversion: 2.1 time: 0.145148 Aug 31 11:52:32.994283 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 523/1045] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:32 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1300 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:33.024192 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-9584113f-a754-4a5c-a5b9-0e89bb12fc39 req-3ac5d06f-d44d-43bd-8529-46296c7d3e93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31561300-9ed1-469f-b8e8-6c2a9d1671ba", "tag": "fa85d695-ba97-45d0-8e07-22981a82dd22"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:33.036444 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-9584113f-a754-4a5c-a5b9-0e89bb12fc39 req-3ac5d06f-d44d-43bd-8529-46296c7d3e93 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:33.036975 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-9584113f-a754-4a5c-a5b9-0e89bb12fc39 req-3ac5d06f-d44d-43bd-8529-46296c7d3e93 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:33.037600 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-9584113f-a754-4a5c-a5b9-0e89bb12fc39 req-3ac5d06f-d44d-43bd-8529-46296c7d3e93 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:33.051845 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-9584113f-a754-4a5c-a5b9-0e89bb12fc39 req-3ac5d06f-d44d-43bd-8529-46296c7d3e93 service nova] Creating event network-changed:fa85d695-ba97-45d0-8e07-22981a82dd22 for instance 31561300-9ed1-469f-b8e8-6c2a9d1671ba on hv-cinder-83976 Aug 31 11:52:33.060547 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-9584113f-a754-4a5c-a5b9-0e89bb12fc39 req-3ac5d06f-d44d-43bd-8529-46296c7d3e93 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046831 Aug 31 11:52:33.065516 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 523/1046] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:52:33.544337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8107bc19-f108-4582-9aa7-6da14b5b4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:33.545250 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8107bc19-f108-4582-9aa7-6da14b5b4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:33.552255 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8107bc19-f108-4582-9aa7-6da14b5b4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:33.552881 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8107bc19-f108-4582-9aa7-6da14b5b4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:33.554055 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8107bc19-f108-4582-9aa7-6da14b5b4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:33.554897 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8107bc19-f108-4582-9aa7-6da14b5b4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:33.555473 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8107bc19-f108-4582-9aa7-6da14b5b4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:33.557190 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8107bc19-f108-4582-9aa7-6da14b5b4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:33.849198 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8107bc19-f108-4582-9aa7-6da14b5b4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:33.862308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8107bc19-f108-4582-9aa7-6da14b5b4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:33.864170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8107bc19-f108-4582-9aa7-6da14b5b4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:33.865724 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8107bc19-f108-4582-9aa7-6da14b5b4390 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1746 microversion: 2.20 time: 0.325380 Aug 31 11:52:33.866457 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 524/1047] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:33 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1746 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:33.990863 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1589981c-a28f-470b-a970-65fd5d3f244f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:33.992921 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1589981c-a28f-470b-a970-65fd5d3f244f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:34.001144 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1589981c-a28f-470b-a970-65fd5d3f244f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:34.001841 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1589981c-a28f-470b-a970-65fd5d3f244f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:34.002326 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1589981c-a28f-470b-a970-65fd5d3f244f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:34.003028 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1589981c-a28f-470b-a970-65fd5d3f244f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:34.003471 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1589981c-a28f-470b-a970-65fd5d3f244f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:34.003909 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1589981c-a28f-470b-a970-65fd5d3f244f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:34.027105 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3685fe2c-db83-4dc5-8531-33fb70e75cba tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:34.028709 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3685fe2c-db83-4dc5-8531-33fb70e75cba tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:34.037018 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3685fe2c-db83-4dc5-8531-33fb70e75cba tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:34.037506 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3685fe2c-db83-4dc5-8531-33fb70e75cba tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:34.037936 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3685fe2c-db83-4dc5-8531-33fb70e75cba tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:34.038652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3685fe2c-db83-4dc5-8531-33fb70e75cba tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:34.039250 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3685fe2c-db83-4dc5-8531-33fb70e75cba tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:34.039977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3685fe2c-db83-4dc5-8531-33fb70e75cba tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:34.173640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1589981c-a28f-470b-a970-65fd5d3f244f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:34.183469 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1589981c-a28f-470b-a970-65fd5d3f244f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 200 len: 1313 microversion: 2.1 time: 0.199250 Aug 31 11:52:34.184146 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 524/1048] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:33 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:34.506745 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3685fe2c-db83-4dc5-8531-33fb70e75cba tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:34.515931 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3685fe2c-db83-4dc5-8531-33fb70e75cba tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1368 microversion: 2.1 time: 0.492952 Aug 31 11:52:34.516568 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 525/1049] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:34 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1368 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:52:34.536957 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-c934e8bd-9497-4a7b-adae-6b0abebfcf5f req-ccbc2810-4fb5-4466-9451-bc02056804cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "052cfef0-621e-4a5e-bb48-b0bd7b753e18", "tag": "8eb80210-6f21-43d5-a6f8-dc5fc8e72708"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:34.548388 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-c934e8bd-9497-4a7b-adae-6b0abebfcf5f req-ccbc2810-4fb5-4466-9451-bc02056804cc service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:34.548918 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-c934e8bd-9497-4a7b-adae-6b0abebfcf5f req-ccbc2810-4fb5-4466-9451-bc02056804cc service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:34.549346 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-c934e8bd-9497-4a7b-adae-6b0abebfcf5f req-ccbc2810-4fb5-4466-9451-bc02056804cc service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:34.561023 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-c934e8bd-9497-4a7b-adae-6b0abebfcf5f req-ccbc2810-4fb5-4466-9451-bc02056804cc service nova] Creating event network-changed:8eb80210-6f21-43d5-a6f8-dc5fc8e72708 for instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 on hv-cinder-83976 Aug 31 11:52:34.566029 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-c934e8bd-9497-4a7b-adae-6b0abebfcf5f req-ccbc2810-4fb5-4466-9451-bc02056804cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033163 Aug 31 11:52:34.566859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 525/1050] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:52:34.890786 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3e2359a7-e4af-45dd-bae2-9d91539aca3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:34.891422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3e2359a7-e4af-45dd-bae2-9d91539aca3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:34.897927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e2359a7-e4af-45dd-bae2-9d91539aca3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:34.898407 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e2359a7-e4af-45dd-bae2-9d91539aca3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:34.898843 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e2359a7-e4af-45dd-bae2-9d91539aca3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:34.899541 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e2359a7-e4af-45dd-bae2-9d91539aca3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:34.899993 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e2359a7-e4af-45dd-bae2-9d91539aca3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:34.900422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e2359a7-e4af-45dd-bae2-9d91539aca3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:35.038895 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3e2359a7-e4af-45dd-bae2-9d91539aca3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:35.048083 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3e2359a7-e4af-45dd-bae2-9d91539aca3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:35.049560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3e2359a7-e4af-45dd-bae2-9d91539aca3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:35.050759 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3e2359a7-e4af-45dd-bae2-9d91539aca3e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1746 microversion: 2.20 time: 0.164633 Aug 31 11:52:35.051324 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 526/1051] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:34 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:35.209643 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-82af3fc0-902f-433d-8327-6b1ac4cd085c tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:35.210257 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-82af3fc0-902f-433d-8327-6b1ac4cd085c tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:35.217413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-82af3fc0-902f-433d-8327-6b1ac4cd085c tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:35.217901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-82af3fc0-902f-433d-8327-6b1ac4cd085c tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:35.218336 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-82af3fc0-902f-433d-8327-6b1ac4cd085c tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:35.219079 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-82af3fc0-902f-433d-8327-6b1ac4cd085c tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:35.219529 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-82af3fc0-902f-433d-8327-6b1ac4cd085c tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:35.219978 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-82af3fc0-902f-433d-8327-6b1ac4cd085c tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:35.381665 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-82af3fc0-902f-433d-8327-6b1ac4cd085c tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:35.391265 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-82af3fc0-902f-433d-8327-6b1ac4cd085c tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 200 len: 1313 microversion: 2.1 time: 0.186405 Aug 31 11:52:35.391898 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 526/1052] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:35 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:35.547070 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-12ecb1f3-b2bf-4106-97c5-4939ceb195de tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:35.547683 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-12ecb1f3-b2bf-4106-97c5-4939ceb195de tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:35.554165 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-12ecb1f3-b2bf-4106-97c5-4939ceb195de tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:35.554664 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-12ecb1f3-b2bf-4106-97c5-4939ceb195de tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:35.555093 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-12ecb1f3-b2bf-4106-97c5-4939ceb195de tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:35.555796 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-12ecb1f3-b2bf-4106-97c5-4939ceb195de tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:35.556240 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-12ecb1f3-b2bf-4106-97c5-4939ceb195de tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:35.556703 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-12ecb1f3-b2bf-4106-97c5-4939ceb195de tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:35.702964 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-12ecb1f3-b2bf-4106-97c5-4939ceb195de tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:35.712566 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-12ecb1f3-b2bf-4106-97c5-4939ceb195de tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1368 microversion: 2.1 time: 0.169441 Aug 31 11:52:35.713491 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 527/1053] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:35 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:36.074926 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2b2929da-d68c-47e0-921b-c7600b2b03fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:36.075594 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2b2929da-d68c-47e0-921b-c7600b2b03fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:36.083339 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b2929da-d68c-47e0-921b-c7600b2b03fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:36.083841 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b2929da-d68c-47e0-921b-c7600b2b03fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:36.084276 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b2929da-d68c-47e0-921b-c7600b2b03fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:36.085019 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b2929da-d68c-47e0-921b-c7600b2b03fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:36.085470 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b2929da-d68c-47e0-921b-c7600b2b03fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:36.085902 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b2929da-d68c-47e0-921b-c7600b2b03fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:36.233292 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2b2929da-d68c-47e0-921b-c7600b2b03fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:36.244026 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2b2929da-d68c-47e0-921b-c7600b2b03fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:36.245848 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2b2929da-d68c-47e0-921b-c7600b2b03fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:36.248631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2b2929da-d68c-47e0-921b-c7600b2b03fc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1746 microversion: 2.20 time: 0.176549 Aug 31 11:52:36.260517 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 527/1054] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:36 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1746 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:36.417280 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-44552293-e8d8-475f-b6a6-628cd1a9c1e9 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:36.418320 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-44552293-e8d8-475f-b6a6-628cd1a9c1e9 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:36.431277 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-44552293-e8d8-475f-b6a6-628cd1a9c1e9 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:36.432147 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-44552293-e8d8-475f-b6a6-628cd1a9c1e9 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:36.432928 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-44552293-e8d8-475f-b6a6-628cd1a9c1e9 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:36.433907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-44552293-e8d8-475f-b6a6-628cd1a9c1e9 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:36.434640 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-44552293-e8d8-475f-b6a6-628cd1a9c1e9 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:36.435780 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-44552293-e8d8-475f-b6a6-628cd1a9c1e9 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:36.733799 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d7347959-2ccd-4691-900d-b30efd1a11a7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:36.734405 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d7347959-2ccd-4691-900d-b30efd1a11a7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:36.740837 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d7347959-2ccd-4691-900d-b30efd1a11a7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:36.741551 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d7347959-2ccd-4691-900d-b30efd1a11a7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:36.742166 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d7347959-2ccd-4691-900d-b30efd1a11a7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:36.743184 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d7347959-2ccd-4691-900d-b30efd1a11a7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:36.743827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d7347959-2ccd-4691-900d-b30efd1a11a7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:36.744401 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d7347959-2ccd-4691-900d-b30efd1a11a7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:36.781105 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-44552293-e8d8-475f-b6a6-628cd1a9c1e9 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:36.795977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-44552293-e8d8-475f-b6a6-628cd1a9c1e9 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 200 len: 1313 microversion: 2.1 time: 0.384700 Aug 31 11:52:36.797249 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 528/1055] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:36 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:37.002018 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d7347959-2ccd-4691-900d-b30efd1a11a7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:37.012170 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d7347959-2ccd-4691-900d-b30efd1a11a7 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1368 microversion: 2.1 time: 0.282758 Aug 31 11:52:37.027938 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 528/1056] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:36 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1368 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:52:37.281183 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-59d342c5-dc06-40e2-a391-bee16e1905bd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:37.282105 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-59d342c5-dc06-40e2-a391-bee16e1905bd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:37.291221 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-59d342c5-dc06-40e2-a391-bee16e1905bd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:37.291713 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-59d342c5-dc06-40e2-a391-bee16e1905bd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:37.292209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-59d342c5-dc06-40e2-a391-bee16e1905bd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:37.292962 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-59d342c5-dc06-40e2-a391-bee16e1905bd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:37.293602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-59d342c5-dc06-40e2-a391-bee16e1905bd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:37.294342 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-59d342c5-dc06-40e2-a391-bee16e1905bd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:37.459041 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-59d342c5-dc06-40e2-a391-bee16e1905bd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:37.468296 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-59d342c5-dc06-40e2-a391-bee16e1905bd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:37.469923 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-59d342c5-dc06-40e2-a391-bee16e1905bd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:37.471215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-59d342c5-dc06-40e2-a391-bee16e1905bd tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1741 microversion: 2.20 time: 0.195149 Aug 31 11:52:37.471850 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 529/1057] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:37 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:37.827071 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f3bd2423-bb8d-49fe-a272-13b2824c4916 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:37.827879 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f3bd2423-bb8d-49fe-a272-13b2824c4916 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:37.836137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3bd2423-bb8d-49fe-a272-13b2824c4916 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:37.836846 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3bd2423-bb8d-49fe-a272-13b2824c4916 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:37.837363 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3bd2423-bb8d-49fe-a272-13b2824c4916 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:37.838449 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3bd2423-bb8d-49fe-a272-13b2824c4916 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:37.839061 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3bd2423-bb8d-49fe-a272-13b2824c4916 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:37.839832 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3bd2423-bb8d-49fe-a272-13b2824c4916 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:38.040934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2d50dfe0-585c-42a2-8dc2-1eff83edf9dc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:38.041622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2d50dfe0-585c-42a2-8dc2-1eff83edf9dc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:38.059193 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d50dfe0-585c-42a2-8dc2-1eff83edf9dc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:38.062679 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d50dfe0-585c-42a2-8dc2-1eff83edf9dc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:38.063354 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d50dfe0-585c-42a2-8dc2-1eff83edf9dc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:38.064688 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d50dfe0-585c-42a2-8dc2-1eff83edf9dc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:38.065466 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d50dfe0-585c-42a2-8dc2-1eff83edf9dc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:38.066229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2d50dfe0-585c-42a2-8dc2-1eff83edf9dc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:38.068899 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f3bd2423-bb8d-49fe-a272-13b2824c4916 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:38.082511 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f3bd2423-bb8d-49fe-a272-13b2824c4916 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 200 len: 1313 microversion: 2.1 time: 0.263497 Aug 31 11:52:38.083309 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 529/1058] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:37 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:52:38.335934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2d50dfe0-585c-42a2-8dc2-1eff83edf9dc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:38.348309 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2d50dfe0-585c-42a2-8dc2-1eff83edf9dc tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1368 microversion: 2.1 time: 0.311817 Aug 31 11:52:38.361906 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 530/1059] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:38 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1368 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:38.496383 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1b45b55f-734f-4137-bb5b-f7b225dcc169 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:38.497162 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1b45b55f-734f-4137-bb5b-f7b225dcc169 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:38.504460 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1b45b55f-734f-4137-bb5b-f7b225dcc169 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:38.505334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1b45b55f-734f-4137-bb5b-f7b225dcc169 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:38.505867 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1b45b55f-734f-4137-bb5b-f7b225dcc169 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:38.506749 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1b45b55f-734f-4137-bb5b-f7b225dcc169 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:38.507458 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1b45b55f-734f-4137-bb5b-f7b225dcc169 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:38.508347 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1b45b55f-734f-4137-bb5b-f7b225dcc169 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:38.677396 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1b45b55f-734f-4137-bb5b-f7b225dcc169 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:38.692214 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1b45b55f-734f-4137-bb5b-f7b225dcc169 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:38.694747 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1b45b55f-734f-4137-bb5b-f7b225dcc169 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:38.696107 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1b45b55f-734f-4137-bb5b-f7b225dcc169 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1741 microversion: 2.20 time: 0.204250 Aug 31 11:52:38.712536 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 530/1060] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:38 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:39.132829 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c452cd05-21a3-40fe-98ef-a8c74737e625 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:39.133662 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c452cd05-21a3-40fe-98ef-a8c74737e625 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:39.141635 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c452cd05-21a3-40fe-98ef-a8c74737e625 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:39.142136 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c452cd05-21a3-40fe-98ef-a8c74737e625 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:39.143182 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c452cd05-21a3-40fe-98ef-a8c74737e625 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:39.144163 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c452cd05-21a3-40fe-98ef-a8c74737e625 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:39.144945 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c452cd05-21a3-40fe-98ef-a8c74737e625 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:39.145422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c452cd05-21a3-40fe-98ef-a8c74737e625 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:39.318490 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c452cd05-21a3-40fe-98ef-a8c74737e625 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:39.328149 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c452cd05-21a3-40fe-98ef-a8c74737e625 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 200 len: 1313 microversion: 2.1 time: 0.200573 Aug 31 11:52:39.329466 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 531/1061] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:39 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:39.371320 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-1c6879f0-ace4-4b9c-8659-7a0329801a9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:39.372947 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-1c6879f0-ace4-4b9c-8659-7a0329801a9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:39.383514 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:39.387178 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1c6879f0-ace4-4b9c-8659-7a0329801a9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:39.388567 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1c6879f0-ace4-4b9c-8659-7a0329801a9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:39.389236 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1c6879f0-ace4-4b9c-8659-7a0329801a9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:39.390241 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1c6879f0-ace4-4b9c-8659-7a0329801a9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:39.390964 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1c6879f0-ace4-4b9c-8659-7a0329801a9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:39.391611 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-1c6879f0-ace4-4b9c-8659-7a0329801a9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:39.623720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-1c6879f0-ace4-4b9c-8659-7a0329801a9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:39.634166 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-1c6879f0-ace4-4b9c-8659-7a0329801a9f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1368 microversion: 2.1 time: 0.266822 Aug 31 11:52:39.635031 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 531/1062] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:39 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:52:39.739460 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-23ab505d-29e6-4778-bc54-6fc31e5d3387 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:39.740536 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-23ab505d-29e6-4778-bc54-6fc31e5d3387 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:39.747991 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-23ab505d-29e6-4778-bc54-6fc31e5d3387 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:39.748826 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-23ab505d-29e6-4778-bc54-6fc31e5d3387 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:39.749365 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-23ab505d-29e6-4778-bc54-6fc31e5d3387 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:39.750207 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-23ab505d-29e6-4778-bc54-6fc31e5d3387 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:39.750696 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-23ab505d-29e6-4778-bc54-6fc31e5d3387 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:39.751132 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-23ab505d-29e6-4778-bc54-6fc31e5d3387 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:39.823650 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-fea10dea-4e55-47ea-b79d-38b00be1ffe3 req-a0a09e04-ae81-45d8-9076-594cb97413b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31561300-9ed1-469f-b8e8-6c2a9d1671ba", "name": "network-vif-plugged", "status": "completed", "tag": "fa85d695-ba97-45d0-8e07-22981a82dd22"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:39.837086 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-fea10dea-4e55-47ea-b79d-38b00be1ffe3 req-a0a09e04-ae81-45d8-9076-594cb97413b9 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:39.837574 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-fea10dea-4e55-47ea-b79d-38b00be1ffe3 req-a0a09e04-ae81-45d8-9076-594cb97413b9 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:39.838037 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-fea10dea-4e55-47ea-b79d-38b00be1ffe3 req-a0a09e04-ae81-45d8-9076-594cb97413b9 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:39.853787 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-fea10dea-4e55-47ea-b79d-38b00be1ffe3 req-a0a09e04-ae81-45d8-9076-594cb97413b9 service nova] Creating event network-vif-plugged:fa85d695-ba97-45d0-8e07-22981a82dd22 for instance 31561300-9ed1-469f-b8e8-6c2a9d1671ba on hv-cinder-83976 Aug 31 11:52:39.865816 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-fea10dea-4e55-47ea-b79d-38b00be1ffe3 req-a0a09e04-ae81-45d8-9076-594cb97413b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045249 Aug 31 11:52:39.869896 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 532/1063] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:52:39.956853 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-23ab505d-29e6-4778-bc54-6fc31e5d3387 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:39.969205 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-23ab505d-29e6-4778-bc54-6fc31e5d3387 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:39.971238 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-23ab505d-29e6-4778-bc54-6fc31e5d3387 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:39.973052 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-23ab505d-29e6-4778-bc54-6fc31e5d3387 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1741 microversion: 2.20 time: 0.237414 Aug 31 11:52:39.974197 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 532/1064] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:39 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1741 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:40.355653 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-931a51b9-5cf2-4e4b-8090-09c501ceace7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:40.357833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-931a51b9-5cf2-4e4b-8090-09c501ceace7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:40.366237 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-931a51b9-5cf2-4e4b-8090-09c501ceace7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:40.367149 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-931a51b9-5cf2-4e4b-8090-09c501ceace7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:40.368534 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-931a51b9-5cf2-4e4b-8090-09c501ceace7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:40.369520 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-931a51b9-5cf2-4e4b-8090-09c501ceace7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:40.370084 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-931a51b9-5cf2-4e4b-8090-09c501ceace7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:40.370624 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-931a51b9-5cf2-4e4b-8090-09c501ceace7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:40.580416 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-931a51b9-5cf2-4e4b-8090-09c501ceace7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:40.588842 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-931a51b9-5cf2-4e4b-8090-09c501ceace7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 200 len: 1313 microversion: 2.1 time: 0.240276 Aug 31 11:52:40.589431 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 533/1065] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:40 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:52:40.662523 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a06ee00a-4568-4a12-ae1e-81632256118f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:40.663796 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a06ee00a-4568-4a12-ae1e-81632256118f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:40.670326 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:40.671433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=12 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:40.685411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a06ee00a-4568-4a12-ae1e-81632256118f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:40.686110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a06ee00a-4568-4a12-ae1e-81632256118f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:40.686859 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a06ee00a-4568-4a12-ae1e-81632256118f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:40.688355 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a06ee00a-4568-4a12-ae1e-81632256118f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:40.689173 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a06ee00a-4568-4a12-ae1e-81632256118f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:40.690528 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a06ee00a-4568-4a12-ae1e-81632256118f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:40.886232 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a06ee00a-4568-4a12-ae1e-81632256118f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:40.896217 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a06ee00a-4568-4a12-ae1e-81632256118f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1368 microversion: 2.1 time: 0.240934 Aug 31 11:52:40.909139 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 533/1066] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:40 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:41.004832 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-868ba313-b171-410a-b131-f07a6fabe9c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:41.006021 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-868ba313-b171-410a-b131-f07a6fabe9c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:41.009438 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=8 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:41.010405 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:41.015143 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-868ba313-b171-410a-b131-f07a6fabe9c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:41.015576 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-868ba313-b171-410a-b131-f07a6fabe9c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:41.015972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-868ba313-b171-410a-b131-f07a6fabe9c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:41.016745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-868ba313-b171-410a-b131-f07a6fabe9c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:41.017316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-868ba313-b171-410a-b131-f07a6fabe9c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:41.017721 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-868ba313-b171-410a-b131-f07a6fabe9c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:41.214744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-868ba313-b171-410a-b131-f07a6fabe9c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:41.225215 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-868ba313-b171-410a-b131-f07a6fabe9c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:41.230077 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-868ba313-b171-410a-b131-f07a6fabe9c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:41.230077 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-868ba313-b171-410a-b131-f07a6fabe9c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1741 microversion: 2.20 time: 0.230235 Aug 31 11:52:41.230077 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 534/1067] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:40 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:41.610212 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-212a3547-d095-44bc-b497-e4c2ab624d37 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:41.611219 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-212a3547-d095-44bc-b497-e4c2ab624d37 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:41.613993 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:41.620213 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-212a3547-d095-44bc-b497-e4c2ab624d37 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:41.621080 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-212a3547-d095-44bc-b497-e4c2ab624d37 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:41.621759 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-212a3547-d095-44bc-b497-e4c2ab624d37 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:41.622797 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-212a3547-d095-44bc-b497-e4c2ab624d37 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:41.624236 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-212a3547-d095-44bc-b497-e4c2ab624d37 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:41.624918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-212a3547-d095-44bc-b497-e4c2ab624d37 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:41.808167 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-212a3547-d095-44bc-b497-e4c2ab624d37 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:41.817569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-212a3547-d095-44bc-b497-e4c2ab624d37 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 200 len: 1313 microversion: 2.1 time: 0.211462 Aug 31 11:52:41.818254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 534/1068] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:41 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:41.916447 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-e6c67886-7f4f-4b98-ad23-b7f892594dcc req-04aa3ab5-e6a6-4510-9a09-002244997417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "052cfef0-621e-4a5e-bb48-b0bd7b753e18", "name": "network-vif-plugged", "status": "completed", "tag": "8eb80210-6f21-43d5-a6f8-dc5fc8e72708"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:41.919913 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-72700702-0d35-4c98-b46a-34c7ba49c010 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:41.920648 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-72700702-0d35-4c98-b46a-34c7ba49c010 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:41.927263 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72700702-0d35-4c98-b46a-34c7ba49c010 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:41.927799 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72700702-0d35-4c98-b46a-34c7ba49c010 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:41.928278 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72700702-0d35-4c98-b46a-34c7ba49c010 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:41.929190 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72700702-0d35-4c98-b46a-34c7ba49c010 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:41.929712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72700702-0d35-4c98-b46a-34c7ba49c010 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:41.930187 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-72700702-0d35-4c98-b46a-34c7ba49c010 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:41.934109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-e6c67886-7f4f-4b98-ad23-b7f892594dcc req-04aa3ab5-e6a6-4510-9a09-002244997417 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:41.935533 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-e6c67886-7f4f-4b98-ad23-b7f892594dcc req-04aa3ab5-e6a6-4510-9a09-002244997417 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:41.936583 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-e6c67886-7f4f-4b98-ad23-b7f892594dcc req-04aa3ab5-e6a6-4510-9a09-002244997417 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:41.958541 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-e6c67886-7f4f-4b98-ad23-b7f892594dcc req-04aa3ab5-e6a6-4510-9a09-002244997417 service nova] Creating event network-vif-plugged:8eb80210-6f21-43d5-a6f8-dc5fc8e72708 for instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 on hv-cinder-83976 Aug 31 11:52:41.968548 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-e6c67886-7f4f-4b98-ad23-b7f892594dcc req-04aa3ab5-e6a6-4510-9a09-002244997417 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061554 Aug 31 11:52:41.970269 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 535/1069] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:52:42.129136 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-72700702-0d35-4c98-b46a-34c7ba49c010 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:42.142333 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-72700702-0d35-4c98-b46a-34c7ba49c010 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1368 microversion: 2.1 time: 0.226626 Aug 31 11:52:42.142917 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 535/1070] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:41 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:52:42.255827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0a851f0f-2929-412c-9135-10d8575a27e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:42.256973 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-0a851f0f-2929-412c-9135-10d8575a27e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:42.265110 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a851f0f-2929-412c-9135-10d8575a27e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:42.265617 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a851f0f-2929-412c-9135-10d8575a27e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:42.266253 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a851f0f-2929-412c-9135-10d8575a27e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:42.266966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a851f0f-2929-412c-9135-10d8575a27e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:42.267419 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a851f0f-2929-412c-9135-10d8575a27e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:42.267848 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a851f0f-2929-412c-9135-10d8575a27e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:42.511367 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0a851f0f-2929-412c-9135-10d8575a27e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:42.516412 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=100 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:42.523868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0a851f0f-2929-412c-9135-10d8575a27e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:42.526617 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0a851f0f-2929-412c-9135-10d8575a27e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:42.528230 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0a851f0f-2929-412c-9135-10d8575a27e9 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1741 microversion: 2.20 time: 0.276914 Aug 31 11:52:42.529119 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 536/1071] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:42 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1741 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:42.842890 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c9974244-0171-4a5d-ab70-86b2ff480fb8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:42.843584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c9974244-0171-4a5d-ab70-86b2ff480fb8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:42.851417 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c9974244-0171-4a5d-ab70-86b2ff480fb8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:42.851931 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c9974244-0171-4a5d-ab70-86b2ff480fb8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:42.852363 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c9974244-0171-4a5d-ab70-86b2ff480fb8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:42.853118 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c9974244-0171-4a5d-ab70-86b2ff480fb8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:42.853610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c9974244-0171-4a5d-ab70-86b2ff480fb8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:42.854221 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c9974244-0171-4a5d-ab70-86b2ff480fb8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:42.859644 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:43.024683 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c9974244-0171-4a5d-ab70-86b2ff480fb8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:43.033730 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c9974244-0171-4a5d-ab70-86b2ff480fb8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 200 len: 1497 microversion: 2.1 time: 0.195505 Aug 31 11:52:43.034344 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 536/1072] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:42 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:43.177219 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2ea5c3df-e2c2-462b-aedc-0e48b0a3890b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:43.178894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2ea5c3df-e2c2-462b-aedc-0e48b0a3890b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:43.189292 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2ea5c3df-e2c2-462b-aedc-0e48b0a3890b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:43.190439 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2ea5c3df-e2c2-462b-aedc-0e48b0a3890b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:43.199748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2ea5c3df-e2c2-462b-aedc-0e48b0a3890b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:43.200743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2ea5c3df-e2c2-462b-aedc-0e48b0a3890b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:43.201302 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2ea5c3df-e2c2-462b-aedc-0e48b0a3890b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:43.201954 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2ea5c3df-e2c2-462b-aedc-0e48b0a3890b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:43.463089 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2ea5c3df-e2c2-462b-aedc-0e48b0a3890b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:43.479814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2ea5c3df-e2c2-462b-aedc-0e48b0a3890b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1368 microversion: 2.1 time: 0.308025 Aug 31 11:52:43.480796 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 537/1073] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:43 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1368 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:43.557888 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-566fe36f-e8f1-447f-aa98-0e6447b55528 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:43.560021 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-566fe36f-e8f1-447f-aa98-0e6447b55528 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:43.568665 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-566fe36f-e8f1-447f-aa98-0e6447b55528 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:43.570112 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-566fe36f-e8f1-447f-aa98-0e6447b55528 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:43.571040 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-566fe36f-e8f1-447f-aa98-0e6447b55528 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:43.572571 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-566fe36f-e8f1-447f-aa98-0e6447b55528 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:43.573254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-566fe36f-e8f1-447f-aa98-0e6447b55528 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:43.574037 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-566fe36f-e8f1-447f-aa98-0e6447b55528 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:43.765495 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-111af397-f88a-488d-8a3e-473e252cf767 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:43.766362 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-111af397-f88a-488d-8a3e-473e252cf767 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:43.775462 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-111af397-f88a-488d-8a3e-473e252cf767 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:43.776456 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-111af397-f88a-488d-8a3e-473e252cf767 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:43.777128 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-111af397-f88a-488d-8a3e-473e252cf767 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:43.778890 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-111af397-f88a-488d-8a3e-473e252cf767 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:43.780054 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-111af397-f88a-488d-8a3e-473e252cf767 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:43.780632 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-111af397-f88a-488d-8a3e-473e252cf767 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:43.786708 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-566fe36f-e8f1-447f-aa98-0e6447b55528 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:43.802040 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-566fe36f-e8f1-447f-aa98-0e6447b55528 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:43.806334 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-566fe36f-e8f1-447f-aa98-0e6447b55528 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:43.807669 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-566fe36f-e8f1-447f-aa98-0e6447b55528 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1741 microversion: 2.20 time: 0.254763 Aug 31 11:52:43.825023 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 537/1074] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:43 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1741 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:43.840530 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-111af397-f88a-488d-8a3e-473e252cf767 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Going to try to terminate instance {{(pid=127061) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:52:43.935296 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-111af397-f88a-488d-8a3e-473e252cf767 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "DELETE /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 204 len: 0 microversion: 2.1 time: 0.173617 Aug 31 11:52:43.937789 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 538/1075] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:52:43 2022] DELETE /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:52:43.946317 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-fd11053b-d753-4023-85a9-c539be55d199 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:43.950157 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-fd11053b-d753-4023-85a9-c539be55d199 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:43.957987 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd11053b-d753-4023-85a9-c539be55d199 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:43.958506 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd11053b-d753-4023-85a9-c539be55d199 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:43.958948 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd11053b-d753-4023-85a9-c539be55d199 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:43.959733 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd11053b-d753-4023-85a9-c539be55d199 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:43.960204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd11053b-d753-4023-85a9-c539be55d199 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:43.960688 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd11053b-d753-4023-85a9-c539be55d199 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:44.141993 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-fd11053b-d753-4023-85a9-c539be55d199 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:44.150498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-fd11053b-d753-4023-85a9-c539be55d199 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 200 len: 1503 microversion: 2.1 time: 0.208309 Aug 31 11:52:44.151318 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 538/1076] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:43 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:52:44.513818 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-88d1b4a4-3bad-4ca8-b6a2-00db00a2fdac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:44.515412 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-88d1b4a4-3bad-4ca8-b6a2-00db00a2fdac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:44.526976 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88d1b4a4-3bad-4ca8-b6a2-00db00a2fdac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:44.527911 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88d1b4a4-3bad-4ca8-b6a2-00db00a2fdac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:44.529303 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88d1b4a4-3bad-4ca8-b6a2-00db00a2fdac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:44.533559 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88d1b4a4-3bad-4ca8-b6a2-00db00a2fdac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:44.534149 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88d1b4a4-3bad-4ca8-b6a2-00db00a2fdac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:44.534636 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88d1b4a4-3bad-4ca8-b6a2-00db00a2fdac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:44.715688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-88d1b4a4-3bad-4ca8-b6a2-00db00a2fdac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:44.726636 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-88d1b4a4-3bad-4ca8-b6a2-00db00a2fdac tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1558 microversion: 2.1 time: 0.220609 Aug 31 11:52:44.727255 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 539/1077] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:44 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:44.752153 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-286aba4d-49f4-46c7-a15f-2b52ffb5f884 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:44.753474 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-286aba4d-49f4-46c7-a15f-2b52ffb5f884 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:44.766376 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-286aba4d-49f4-46c7-a15f-2b52ffb5f884 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:44.767574 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-286aba4d-49f4-46c7-a15f-2b52ffb5f884 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:44.768570 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-286aba4d-49f4-46c7-a15f-2b52ffb5f884 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:44.770221 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-286aba4d-49f4-46c7-a15f-2b52ffb5f884 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:44.771255 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-286aba4d-49f4-46c7-a15f-2b52ffb5f884 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:44.772245 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-286aba4d-49f4-46c7-a15f-2b52ffb5f884 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:44.833184 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c04aa376-046d-451c-b3f6-f3c521b90997 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:44.834223 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c04aa376-046d-451c-b3f6-f3c521b90997 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:44.844937 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c04aa376-046d-451c-b3f6-f3c521b90997 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:44.845747 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c04aa376-046d-451c-b3f6-f3c521b90997 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:44.846540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c04aa376-046d-451c-b3f6-f3c521b90997 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:44.847772 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c04aa376-046d-451c-b3f6-f3c521b90997 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:44.848517 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c04aa376-046d-451c-b3f6-f3c521b90997 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:44.849108 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c04aa376-046d-451c-b3f6-f3c521b90997 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:44.907934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-286aba4d-49f4-46c7-a15f-2b52ffb5f884 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.163709 Aug 31 11:52:44.919419 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 539/1078] 10.222.0.60 () {58 vars in 1275 bytes} [Wed Aug 31 11:52:44 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:52:45.039781 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c04aa376-046d-451c-b3f6-f3c521b90997 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:45.055056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c04aa376-046d-451c-b3f6-f3c521b90997 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:45.056732 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c04aa376-046d-451c-b3f6-f3c521b90997 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:45.057977 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c04aa376-046d-451c-b3f6-f3c521b90997 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1741 microversion: 2.20 time: 0.230210 Aug 31 11:52:45.062121 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 540/1079] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:44 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1741 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:52:45.175537 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4634db9e-6fab-4cb7-8cb1-b437d3df5a5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:45.176203 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4634db9e-6fab-4cb7-8cb1-b437d3df5a5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:45.183743 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4634db9e-6fab-4cb7-8cb1-b437d3df5a5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:45.184598 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4634db9e-6fab-4cb7-8cb1-b437d3df5a5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:45.185042 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4634db9e-6fab-4cb7-8cb1-b437d3df5a5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:45.186058 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4634db9e-6fab-4cb7-8cb1-b437d3df5a5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:45.186490 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4634db9e-6fab-4cb7-8cb1-b437d3df5a5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:45.186921 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4634db9e-6fab-4cb7-8cb1-b437d3df5a5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:45.477980 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4634db9e-6fab-4cb7-8cb1-b437d3df5a5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:45.506282 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4634db9e-6fab-4cb7-8cb1-b437d3df5a5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 200 len: 1503 microversion: 2.1 time: 0.318710 Aug 31 11:52:45.507478 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 540/1080] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:45 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 1503 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:46.086168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3c09c569-65cc-4027-b762-acf92bb0f88d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:46.086971 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3c09c569-65cc-4027-b762-acf92bb0f88d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:46.096601 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3c09c569-65cc-4027-b762-acf92bb0f88d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:46.097861 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3c09c569-65cc-4027-b762-acf92bb0f88d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:46.098610 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3c09c569-65cc-4027-b762-acf92bb0f88d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:46.099359 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3c09c569-65cc-4027-b762-acf92bb0f88d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:46.099916 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3c09c569-65cc-4027-b762-acf92bb0f88d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:46.100647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3c09c569-65cc-4027-b762-acf92bb0f88d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:46.297347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-db019cad-c664-48ca-9cfe-ee9a17eab5cf req-159bba75-b70c-43af-beff-ea53d3b5f3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "052cfef0-621e-4a5e-bb48-b0bd7b753e18", "tag": "8eb80210-6f21-43d5-a6f8-dc5fc8e72708"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:46.314846 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-db019cad-c664-48ca-9cfe-ee9a17eab5cf req-159bba75-b70c-43af-beff-ea53d3b5f3d0 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:46.316075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-db019cad-c664-48ca-9cfe-ee9a17eab5cf req-159bba75-b70c-43af-beff-ea53d3b5f3d0 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:46.316669 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-db019cad-c664-48ca-9cfe-ee9a17eab5cf req-159bba75-b70c-43af-beff-ea53d3b5f3d0 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:46.327740 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3c09c569-65cc-4027-b762-acf92bb0f88d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:46.331636 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-db019cad-c664-48ca-9cfe-ee9a17eab5cf req-159bba75-b70c-43af-beff-ea53d3b5f3d0 service nova] Creating event network-changed:8eb80210-6f21-43d5-a6f8-dc5fc8e72708 for instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 on hv-cinder-83976 Aug 31 11:52:46.341272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-db019cad-c664-48ca-9cfe-ee9a17eab5cf req-159bba75-b70c-43af-beff-ea53d3b5f3d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050631 Aug 31 11:52:46.344241 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3c09c569-65cc-4027-b762-acf92bb0f88d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:46.345309 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 541/1081] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:52:46.362133 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3c09c569-65cc-4027-b762-acf92bb0f88d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:46.366345 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3c09c569-65cc-4027-b762-acf92bb0f88d tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1741 microversion: 2.20 time: 0.285792 Aug 31 11:52:46.382019 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 541/1082] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:46 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1741 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:46.532967 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cb4db15d-a170-4b88-bc15-0b61907747d2 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:46.534563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cb4db15d-a170-4b88-bc15-0b61907747d2 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:46.549018 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cb4db15d-a170-4b88-bc15-0b61907747d2 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:46.551018 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cb4db15d-a170-4b88-bc15-0b61907747d2 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:46.551358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cb4db15d-a170-4b88-bc15-0b61907747d2 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:46.553370 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cb4db15d-a170-4b88-bc15-0b61907747d2 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:46.553857 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cb4db15d-a170-4b88-bc15-0b61907747d2 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:46.557717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cb4db15d-a170-4b88-bc15-0b61907747d2 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:46.706629 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-0b02064a-5d80-450c-b94f-72ccd7375402 req-34892f37-71bd-42b2-8247-1abfbf37f6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31561300-9ed1-469f-b8e8-6c2a9d1671ba", "name": "network-vif-deleted", "tag": "fa85d695-ba97-45d0-8e07-22981a82dd22"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:46.745372 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cb4db15d-a170-4b88-bc15-0b61907747d2 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:46.746356 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-0b02064a-5d80-450c-b94f-72ccd7375402 req-34892f37-71bd-42b2-8247-1abfbf37f6ea service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:46.747107 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-0b02064a-5d80-450c-b94f-72ccd7375402 req-34892f37-71bd-42b2-8247-1abfbf37f6ea service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:46.747653 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-0b02064a-5d80-450c-b94f-72ccd7375402 req-34892f37-71bd-42b2-8247-1abfbf37f6ea service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:46.763958 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cb4db15d-a170-4b88-bc15-0b61907747d2 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 200 len: 1461 microversion: 2.1 time: 0.237230 Aug 31 11:52:46.777393 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-0b02064a-5d80-450c-b94f-72ccd7375402 req-34892f37-71bd-42b2-8247-1abfbf37f6ea service nova] Creating event network-vif-deleted:fa85d695-ba97-45d0-8e07-22981a82dd22 for instance 31561300-9ed1-469f-b8e8-6c2a9d1671ba on hv-cinder-83976 Aug 31 11:52:46.777393 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-0b02064a-5d80-450c-b94f-72ccd7375402 req-34892f37-71bd-42b2-8247-1abfbf37f6ea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075566 Aug 31 11:52:46.781260 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 542/1083] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:52:46.785628 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 542/1084] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:46 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 1461 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:52:47.392704 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d211473c-c232-4cc4-884d-9551eb9c39cb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:47.394067 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d211473c-c232-4cc4-884d-9551eb9c39cb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:47.402203 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d211473c-c232-4cc4-884d-9551eb9c39cb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:47.403094 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d211473c-c232-4cc4-884d-9551eb9c39cb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:47.404578 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d211473c-c232-4cc4-884d-9551eb9c39cb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:47.405721 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d211473c-c232-4cc4-884d-9551eb9c39cb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:47.406555 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d211473c-c232-4cc4-884d-9551eb9c39cb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:47.407340 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d211473c-c232-4cc4-884d-9551eb9c39cb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:47.648417 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d211473c-c232-4cc4-884d-9551eb9c39cb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:47.658150 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d211473c-c232-4cc4-884d-9551eb9c39cb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:47.661075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-d211473c-c232-4cc4-884d-9551eb9c39cb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:47.662682 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d211473c-c232-4cc4-884d-9551eb9c39cb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1741 microversion: 2.20 time: 0.275386 Aug 31 11:52:47.680773 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 543/1085] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:47 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:47.790536 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0af98564-7427-4aae-978d-1e89aef551a7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:47.792409 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0af98564-7427-4aae-978d-1e89aef551a7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: 31561300-9ed1-469f-b8e8-6c2a9d1671ba] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:47.802182 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0af98564-7427-4aae-978d-1e89aef551a7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:47.802673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0af98564-7427-4aae-978d-1e89aef551a7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:47.803106 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0af98564-7427-4aae-978d-1e89aef551a7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:47.803815 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0af98564-7427-4aae-978d-1e89aef551a7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:47.804261 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0af98564-7427-4aae-978d-1e89aef551a7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:47.804712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0af98564-7427-4aae-978d-1e89aef551a7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:47.824208 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-0af98564-7427-4aae-978d-1e89aef551a7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] HTTP exception thrown: Instance 31561300-9ed1-469f-b8e8-6c2a9d1671ba could not be found. Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0af98564-7427-4aae-978d-1e89aef551a7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Request method failure captured: Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba HTTP/1.1 Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0t6KDDIZu8HZQJ0uaVQrwKXoFo0mTznmWZiOpqSbkzyVOUs1DM5fMA5p4l7Mu5JQaz8Cc3FeAMqWWnF1KniAmccRocivexj9la0sQOpyob7mQ5_v9pxqv_0GXrQZeHqWDNkSHivNh_U_23UKcX9R-qqpZ_za64laNATTvPSbVCOnVA Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 2dbfe7ba453b472ba09b554b59d79281 Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-VolumesActionsTest-121899231 Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:52:47.826358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:52:47.828036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2dbfe7ba453b472ba09b554b59d79281", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2dbfe7ba453b472ba09b554b59d79281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2dbfe7ba453b472ba09b554b59d79281"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2dbfe7ba453b472ba09b554b59d79281"}]}] Aug 31 11:52:47.828036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-VolumesActionsTest-121899231 Aug 31 11:52:47.828036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 2dbfe7ba453b472ba09b554b59d79281 Aug 31 11:52:47.828036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-VolumesActionsTest-121899231 Aug 31 11:52:47.828036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-VolumesActionsTest-121899231-project Aug 31 11:52:47.828036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:52:47.828036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:52:47.828036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: ea03ffe5a78e4741a47aa8087db14053 Aug 31 11:52:47.828036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-VolumesActionsTest-121899231-project Aug 31 11:52:47.828036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:52:47.828036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance 31561300-9ed1-469f-b8e8-6c2a9d1671ba could not be found. Aug 31 11:52:47.828036 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': '31561300-9ed1-469f-b8e8-6c2a9d1671ba'} Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31561300-9ed1-469f-b8e8-6c2a9d1671ba could not be found. Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:52:47.829067 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31561300-9ed1-469f-b8e8-6c2a9d1671ba could not be found. Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31561300-9ed1-469f-b8e8-6c2a9d1671ba could not be found. Aug 31 11:52:47.830551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:52:47.832812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0af98564-7427-4aae-978d-1e89aef551a7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Returning 404 to user: Instance 31561300-9ed1-469f-b8e8-6c2a9d1671ba could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:52:47.833889 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0af98564-7427-4aae-978d-1e89aef551a7 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba" status: 404 len: 111 microversion: 2.1 time: 0.048559 Aug 31 11:52:47.834916 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 543/1086] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:47 2022] GET /compute/v2.1/servers/31561300-9ed1-469f-b8e8-6c2a9d1671ba => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:52:47.899763 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-467734250", "imageRef": "37d3fa58-8787-4754-82b0-9db5cf8ec087", "flavorRef": "452", "networks": [{"uuid": "184b7f94-1618-4f83-b503-001697392805"}]}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:47.973414 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.network.neutron [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] validate_networks() for [('184b7f94-1618-4f83-b503-001697392805', None, None, None, None, None)] {{(pid=127061) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:52:48.392067 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Flavor limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:52:48.392685 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Image limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:52:48.393321 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Flavor pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:52:48.394113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Image pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:52:48.394113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:52:48.408834 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:48.409311 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:48.409740 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:48.410595 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:48.411109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:48.411946 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:48.432792 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Getting quotas for project 2dbfe7ba453b472ba09b554b59d79281. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:52:48.437726 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Getting quotas for user ea03ffe5a78e4741a47aa8087db14053 and project 2dbfe7ba453b472ba09b554b59d79281. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:52:48.451532 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Going to run 1 instances... {{(pid=127061) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:52:48.453848 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='37d3fa58-8787-4754-82b0-9db5cf8ec087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127061) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:52:48.507622 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9a8a9c40-41d6-4a5e-af21-a3ec9837eb12 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613533 Aug 31 11:52:48.508408 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 544/1087] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:52:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:52:48.520193 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0519050e-29fd-4a25-8419-8178e73bd34c tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:48.520939 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0519050e-29fd-4a25-8419-8178e73bd34c tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:48.584125 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0519050e-29fd-4a25-8419-8178e73bd34c tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:48.594315 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0519050e-29fd-4a25-8419-8178e73bd34c tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1213 microversion: 2.1 time: 0.078399 Aug 31 11:52:48.595616 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 544/1088] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:48 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:52:48.690672 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e1a5a74e-8083-4161-bacd-79b53850b34c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:48.691428 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e1a5a74e-8083-4161-bacd-79b53850b34c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:48.699239 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1a5a74e-8083-4161-bacd-79b53850b34c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:48.700781 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1a5a74e-8083-4161-bacd-79b53850b34c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:48.701503 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1a5a74e-8083-4161-bacd-79b53850b34c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:48.702447 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1a5a74e-8083-4161-bacd-79b53850b34c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:48.703121 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1a5a74e-8083-4161-bacd-79b53850b34c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:48.703862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e1a5a74e-8083-4161-bacd-79b53850b34c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:48.881366 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e1a5a74e-8083-4161-bacd-79b53850b34c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:48.895000 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e1a5a74e-8083-4161-bacd-79b53850b34c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:48.896425 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e1a5a74e-8083-4161-bacd-79b53850b34c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:48.903800 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e1a5a74e-8083-4161-bacd-79b53850b34c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1741 microversion: 2.20 time: 0.217934 Aug 31 11:52:48.904407 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 545/1089] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:48 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1741 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:49.616047 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-67246baf-34df-4586-8b8d-291595c82e9f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:49.616712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-67246baf-34df-4586-8b8d-291595c82e9f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:49.624506 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-67246baf-34df-4586-8b8d-291595c82e9f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:49.624996 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-67246baf-34df-4586-8b8d-291595c82e9f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:49.625434 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-67246baf-34df-4586-8b8d-291595c82e9f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:49.626161 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-67246baf-34df-4586-8b8d-291595c82e9f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:49.626615 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-67246baf-34df-4586-8b8d-291595c82e9f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:49.627040 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-67246baf-34df-4586-8b8d-291595c82e9f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:49.696784 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-67246baf-34df-4586-8b8d-291595c82e9f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:49.704678 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-67246baf-34df-4586-8b8d-291595c82e9f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1265 microversion: 2.1 time: 0.092639 Aug 31 11:52:49.705245 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 545/1090] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:49 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:49.931441 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3be965f2-2760-437b-b5c4-91b71c25f76e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:49.931985 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3be965f2-2760-437b-b5c4-91b71c25f76e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:49.938500 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3be965f2-2760-437b-b5c4-91b71c25f76e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:49.939011 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3be965f2-2760-437b-b5c4-91b71c25f76e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:49.939475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3be965f2-2760-437b-b5c4-91b71c25f76e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:49.940168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3be965f2-2760-437b-b5c4-91b71c25f76e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:49.940646 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3be965f2-2760-437b-b5c4-91b71c25f76e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:49.941097 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3be965f2-2760-437b-b5c4-91b71c25f76e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:50.088686 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3be965f2-2760-437b-b5c4-91b71c25f76e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:50.098848 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3be965f2-2760-437b-b5c4-91b71c25f76e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:50.100374 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3be965f2-2760-437b-b5c4-91b71c25f76e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:50.101800 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3be965f2-2760-437b-b5c4-91b71c25f76e tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1741 microversion: 2.20 time: 0.174398 Aug 31 11:52:50.102457 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 546/1091] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:49 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:50.727332 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-11ab1546-1a9e-49b7-8ce5-ccece3ea1161 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:50.728613 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-11ab1546-1a9e-49b7-8ce5-ccece3ea1161 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:50.736746 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11ab1546-1a9e-49b7-8ce5-ccece3ea1161 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:50.737525 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11ab1546-1a9e-49b7-8ce5-ccece3ea1161 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:50.738144 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11ab1546-1a9e-49b7-8ce5-ccece3ea1161 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:50.738854 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11ab1546-1a9e-49b7-8ce5-ccece3ea1161 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:50.739932 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11ab1546-1a9e-49b7-8ce5-ccece3ea1161 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:50.740551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-11ab1546-1a9e-49b7-8ce5-ccece3ea1161 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:50.825074 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-11ab1546-1a9e-49b7-8ce5-ccece3ea1161 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:50.833347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-11ab1546-1a9e-49b7-8ce5-ccece3ea1161 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1271 microversion: 2.1 time: 0.109707 Aug 31 11:52:50.834309 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 546/1092] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:50 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:51.125039 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7e459e70-f720-4a8a-8e26-aa910c5c99a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:51.125649 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-7e459e70-f720-4a8a-8e26-aa910c5c99a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:51.134480 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7e459e70-f720-4a8a-8e26-aa910c5c99a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:51.134978 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7e459e70-f720-4a8a-8e26-aa910c5c99a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:51.135671 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7e459e70-f720-4a8a-8e26-aa910c5c99a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:51.136511 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7e459e70-f720-4a8a-8e26-aa910c5c99a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:51.137207 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7e459e70-f720-4a8a-8e26-aa910c5c99a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:51.138110 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-7e459e70-f720-4a8a-8e26-aa910c5c99a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:51.283072 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7e459e70-f720-4a8a-8e26-aa910c5c99a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:51.291810 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7e459e70-f720-4a8a-8e26-aa910c5c99a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:51.293316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-7e459e70-f720-4a8a-8e26-aa910c5c99a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:51.295808 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7e459e70-f720-4a8a-8e26-aa910c5c99a6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1723 microversion: 2.20 time: 0.175068 Aug 31 11:52:51.296370 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 547/1093] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:51 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:51.854509 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-47623bd1-f689-495e-b82e-df009c383aa8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:51.855123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-47623bd1-f689-495e-b82e-df009c383aa8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:51.861970 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-47623bd1-f689-495e-b82e-df009c383aa8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:51.862455 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-47623bd1-f689-495e-b82e-df009c383aa8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:51.862892 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-47623bd1-f689-495e-b82e-df009c383aa8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:51.863595 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-47623bd1-f689-495e-b82e-df009c383aa8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:51.864046 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-47623bd1-f689-495e-b82e-df009c383aa8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:51.864469 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-47623bd1-f689-495e-b82e-df009c383aa8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:51.994911 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-47623bd1-f689-495e-b82e-df009c383aa8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:52.003409 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-47623bd1-f689-495e-b82e-df009c383aa8 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.152818 Aug 31 11:52:52.003971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 547/1094] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:51 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:52.319911 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-38afac79-de3d-471a-924b-2ab18b423289 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:52.320531 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-38afac79-de3d-471a-924b-2ab18b423289 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:52.327569 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38afac79-de3d-471a-924b-2ab18b423289 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:52.328130 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38afac79-de3d-471a-924b-2ab18b423289 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:52.328588 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38afac79-de3d-471a-924b-2ab18b423289 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:52.329317 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38afac79-de3d-471a-924b-2ab18b423289 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:52.329756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38afac79-de3d-471a-924b-2ab18b423289 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:52.330182 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-38afac79-de3d-471a-924b-2ab18b423289 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:52.469962 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-38afac79-de3d-471a-924b-2ab18b423289 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:52.478342 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-38afac79-de3d-471a-924b-2ab18b423289 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:52.479810 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-38afac79-de3d-471a-924b-2ab18b423289 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:52.481006 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-38afac79-de3d-471a-924b-2ab18b423289 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1723 microversion: 2.20 time: 0.165578 Aug 31 11:52:52.483214 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 548/1095] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:52 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:52.928321 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-27885728-85b3-4304-a449-83f345a3b2d1 req-feb68157-c191-4a3e-ac59-d600e3b71d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a8b816-21a4-4281-b63e-b0800284a77c", "tag": "3277ada0-073c-4e05-bad0-cc0a0559d656"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:52.938560 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-27885728-85b3-4304-a449-83f345a3b2d1 req-feb68157-c191-4a3e-ac59-d600e3b71d02 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:52.939026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-27885728-85b3-4304-a449-83f345a3b2d1 req-feb68157-c191-4a3e-ac59-d600e3b71d02 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:52.939456 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-27885728-85b3-4304-a449-83f345a3b2d1 req-feb68157-c191-4a3e-ac59-d600e3b71d02 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:52.951957 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-27885728-85b3-4304-a449-83f345a3b2d1 req-feb68157-c191-4a3e-ac59-d600e3b71d02 service nova] Creating event network-changed:3277ada0-073c-4e05-bad0-cc0a0559d656 for instance f9a8b816-21a4-4281-b63e-b0800284a77c on hv-cinder-83976 Aug 31 11:52:52.957049 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-27885728-85b3-4304-a449-83f345a3b2d1 req-feb68157-c191-4a3e-ac59-d600e3b71d02 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032419 Aug 31 11:52:52.957812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 548/1096] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:52:53.024430 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f3e0fb2e-929f-4e53-826e-1e9a00520f5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:53.025099 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f3e0fb2e-929f-4e53-826e-1e9a00520f5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:53.033179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3e0fb2e-929f-4e53-826e-1e9a00520f5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:53.033959 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3e0fb2e-929f-4e53-826e-1e9a00520f5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:53.034639 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3e0fb2e-929f-4e53-826e-1e9a00520f5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:53.035756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3e0fb2e-929f-4e53-826e-1e9a00520f5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:53.036372 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3e0fb2e-929f-4e53-826e-1e9a00520f5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:53.036983 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f3e0fb2e-929f-4e53-826e-1e9a00520f5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:53.176840 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f3e0fb2e-929f-4e53-826e-1e9a00520f5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:53.185266 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f3e0fb2e-929f-4e53-826e-1e9a00520f5b tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.164560 Aug 31 11:52:53.185771 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 549/1097] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:53 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:53.505772 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c1c4e7df-2161-49d6-82f8-e3b0136de0ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:53.506471 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c1c4e7df-2161-49d6-82f8-e3b0136de0ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:53.513773 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1c4e7df-2161-49d6-82f8-e3b0136de0ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:53.514460 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1c4e7df-2161-49d6-82f8-e3b0136de0ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:53.514896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1c4e7df-2161-49d6-82f8-e3b0136de0ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:53.515602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1c4e7df-2161-49d6-82f8-e3b0136de0ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:53.516053 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1c4e7df-2161-49d6-82f8-e3b0136de0ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:53.516480 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c1c4e7df-2161-49d6-82f8-e3b0136de0ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:53.577764 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-5b0ca837-ffc5-4714-810e-d1acbd235e4c req-9fbe0cec-f4ec-409d-ad6b-6e02738729c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06aad3ea-8a4f-44c5-829c-b0230807fdf7", "name": "network-vif-unplugged", "status": "completed", "tag": "936e8033-671c-4a3d-9abe-a63045a10877"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:53.589632 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-5b0ca837-ffc5-4714-810e-d1acbd235e4c req-9fbe0cec-f4ec-409d-ad6b-6e02738729c0 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:53.590161 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-5b0ca837-ffc5-4714-810e-d1acbd235e4c req-9fbe0cec-f4ec-409d-ad6b-6e02738729c0 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:53.590675 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-5b0ca837-ffc5-4714-810e-d1acbd235e4c req-9fbe0cec-f4ec-409d-ad6b-6e02738729c0 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:53.603300 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.compute.server_external_events [req-5b0ca837-ffc5-4714-810e-d1acbd235e4c req-9fbe0cec-f4ec-409d-ad6b-6e02738729c0 service nova] Unable to find a host for instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7. Dropping event network-vif-unplugged {{(pid=127061) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 11:52:53.604213 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-5b0ca837-ffc5-4714-810e-d1acbd235e4c req-9fbe0cec-f4ec-409d-ad6b-6e02738729c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031526 Aug 31 11:52:53.605073 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 550/1098] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 31 11:52:53.750527 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c1c4e7df-2161-49d6-82f8-e3b0136de0ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:53.759411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c1c4e7df-2161-49d6-82f8-e3b0136de0ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:53.761002 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c1c4e7df-2161-49d6-82f8-e3b0136de0ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:53.762304 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c1c4e7df-2161-49d6-82f8-e3b0136de0ef tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1666 microversion: 2.20 time: 0.260590 Aug 31 11:52:53.763057 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 549/1099] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:53 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1666 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:53.787217 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d89bbce4-6c37-42ec-892d-cab9a8daacdc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1f89242-4b56-40b2-89dd-8cdaccf98596"}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:53.789664 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d89bbce4-6c37-42ec-892d-cab9a8daacdc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:53.796799 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d89bbce4-6c37-42ec-892d-cab9a8daacdc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:53.797293 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d89bbce4-6c37-42ec-892d-cab9a8daacdc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:53.797726 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d89bbce4-6c37-42ec-892d-cab9a8daacdc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:53.798450 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d89bbce4-6c37-42ec-892d-cab9a8daacdc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:53.799121 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d89bbce4-6c37-42ec-892d-cab9a8daacdc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:53.799649 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d89bbce4-6c37-42ec-892d-cab9a8daacdc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:54.069014 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:54.083490 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d89bbce4-6c37-42ec-892d-cab9a8daacdc tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "POST /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300601 Aug 31 11:52:54.084135 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 551/1100] 10.222.0.60 () {62 vars in 1364 bytes} [Wed Aug 31 11:52:53 2022] POST /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:52:54.205576 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2478f25a-3613-4437-ad3f-a7d043ef5431 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:54.206182 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2478f25a-3613-4437-ad3f-a7d043ef5431 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:54.206974 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c16bbbfc-9872-4691-b40e-b44e2eec9f32 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:54.207590 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c16bbbfc-9872-4691-b40e-b44e2eec9f32 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:54.212460 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2478f25a-3613-4437-ad3f-a7d043ef5431 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:54.212958 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2478f25a-3613-4437-ad3f-a7d043ef5431 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:54.213387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2478f25a-3613-4437-ad3f-a7d043ef5431 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:54.213856 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c16bbbfc-9872-4691-b40e-b44e2eec9f32 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:54.214083 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2478f25a-3613-4437-ad3f-a7d043ef5431 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:54.214482 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c16bbbfc-9872-4691-b40e-b44e2eec9f32 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:54.214591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2478f25a-3613-4437-ad3f-a7d043ef5431 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:54.214936 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2478f25a-3613-4437-ad3f-a7d043ef5431 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:54.215091 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c16bbbfc-9872-4691-b40e-b44e2eec9f32 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:54.220111 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c16bbbfc-9872-4691-b40e-b44e2eec9f32 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:54.220659 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c16bbbfc-9872-4691-b40e-b44e2eec9f32 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:54.221189 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c16bbbfc-9872-4691-b40e-b44e2eec9f32 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:54.354249 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2478f25a-3613-4437-ad3f-a7d043ef5431 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:54.363019 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2478f25a-3613-4437-ad3f-a7d043ef5431 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.161340 Aug 31 11:52:54.363601 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 550/1101] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:54 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:54.466279 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c16bbbfc-9872-4691-b40e-b44e2eec9f32 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "DELETE /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7/os-volume_attachments/a1f89242-4b56-40b2-89dd-8cdaccf98596" status: 202 len: 0 microversion: 2.20 time: 0.262736 Aug 31 11:52:54.467335 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 552/1102] 10.222.0.60 () {60 vars in 1457 bytes} [Wed Aug 31 11:52:54 2022] DELETE /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7/os-volume_attachments/a1f89242-4b56-40b2-89dd-8cdaccf98596 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:52:54.527025 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9316d4cb-0e67-4fa2-af53-d5948a5cbec6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:54.527614 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9316d4cb-0e67-4fa2-af53-d5948a5cbec6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:54.534510 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9316d4cb-0e67-4fa2-af53-d5948a5cbec6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:54.534929 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9316d4cb-0e67-4fa2-af53-d5948a5cbec6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:54.535362 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9316d4cb-0e67-4fa2-af53-d5948a5cbec6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:54.536049 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9316d4cb-0e67-4fa2-af53-d5948a5cbec6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:54.536511 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9316d4cb-0e67-4fa2-af53-d5948a5cbec6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:54.536941 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9316d4cb-0e67-4fa2-af53-d5948a5cbec6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:54.567958 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9316d4cb-0e67-4fa2-af53-d5948a5cbec6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127062) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 11:52:54.633730 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9316d4cb-0e67-4fa2-af53-d5948a5cbec6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "POST /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7/action" status: 202 len: 0 microversion: 2.20 time: 0.110559 Aug 31 11:52:54.634531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 551/1103] 10.222.0.60 () {62 vars in 1319 bytes} [Wed Aug 31 11:52:54 2022] POST /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:52:54.643020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-75518a40-d9b1-46b6-9cb6-90ec435a7c99 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:54.643783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-75518a40-d9b1-46b6-9cb6-90ec435a7c99 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:54.650608 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-75518a40-d9b1-46b6-9cb6-90ec435a7c99 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:54.651087 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-75518a40-d9b1-46b6-9cb6-90ec435a7c99 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:54.651511 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-75518a40-d9b1-46b6-9cb6-90ec435a7c99 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:54.652200 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-75518a40-d9b1-46b6-9cb6-90ec435a7c99 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:54.652692 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-75518a40-d9b1-46b6-9cb6-90ec435a7c99 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:54.653214 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-75518a40-d9b1-46b6-9cb6-90ec435a7c99 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:54.838544 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-75518a40-d9b1-46b6-9cb6-90ec435a7c99 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:54.848149 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-75518a40-d9b1-46b6-9cb6-90ec435a7c99 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:54.849649 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-75518a40-d9b1-46b6-9cb6-90ec435a7c99 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:54.850834 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-75518a40-d9b1-46b6-9cb6-90ec435a7c99 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1674 microversion: 2.20 time: 0.212111 Aug 31 11:52:54.851383 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 553/1104] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:54 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1674 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:55.383919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2fca9446-5e8f-462a-8ac1-71a9c79bebf5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:55.384705 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2fca9446-5e8f-462a-8ac1-71a9c79bebf5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:55.390906 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2fca9446-5e8f-462a-8ac1-71a9c79bebf5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:55.391396 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2fca9446-5e8f-462a-8ac1-71a9c79bebf5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:55.391831 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2fca9446-5e8f-462a-8ac1-71a9c79bebf5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:55.392565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2fca9446-5e8f-462a-8ac1-71a9c79bebf5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:55.393016 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2fca9446-5e8f-462a-8ac1-71a9c79bebf5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:55.393434 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2fca9446-5e8f-462a-8ac1-71a9c79bebf5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:55.553687 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2fca9446-5e8f-462a-8ac1-71a9c79bebf5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:55.561724 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2fca9446-5e8f-462a-8ac1-71a9c79bebf5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.182261 Aug 31 11:52:55.562316 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 552/1105] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:55 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:55.875022 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6031b555-9d60-4291-8fb5-59b4c482d067 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:55.875718 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6031b555-9d60-4291-8fb5-59b4c482d067 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:55.882524 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6031b555-9d60-4291-8fb5-59b4c482d067 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:55.883000 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6031b555-9d60-4291-8fb5-59b4c482d067 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:55.883434 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6031b555-9d60-4291-8fb5-59b4c482d067 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:55.884135 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6031b555-9d60-4291-8fb5-59b4c482d067 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:55.884734 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6031b555-9d60-4291-8fb5-59b4c482d067 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:55.890865 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6031b555-9d60-4291-8fb5-59b4c482d067 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:56.166568 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6031b555-9d60-4291-8fb5-59b4c482d067 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:56.183293 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6031b555-9d60-4291-8fb5-59b4c482d067 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:56.185267 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6031b555-9d60-4291-8fb5-59b4c482d067 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:56.187020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6031b555-9d60-4291-8fb5-59b4c482d067 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1674 microversion: 2.20 time: 0.316115 Aug 31 11:52:56.188127 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 554/1106] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:55 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1674 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:56.587077 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-92fe59f2-57c2-46d1-b5e0-eda0c4652f43 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:56.587721 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-92fe59f2-57c2-46d1-b5e0-eda0c4652f43 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:56.594977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-92fe59f2-57c2-46d1-b5e0-eda0c4652f43 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:56.595468 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-92fe59f2-57c2-46d1-b5e0-eda0c4652f43 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:56.595912 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-92fe59f2-57c2-46d1-b5e0-eda0c4652f43 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:56.596678 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-92fe59f2-57c2-46d1-b5e0-eda0c4652f43 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:56.597132 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-92fe59f2-57c2-46d1-b5e0-eda0c4652f43 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:56.597554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-92fe59f2-57c2-46d1-b5e0-eda0c4652f43 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:56.742136 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-92fe59f2-57c2-46d1-b5e0-eda0c4652f43 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:56.752634 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-92fe59f2-57c2-46d1-b5e0-eda0c4652f43 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.169526 Aug 31 11:52:56.753218 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 553/1107] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:56 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:57.216170 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b9390f4c-1bb4-49de-95c8-7a1de302a2b7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:57.217200 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b9390f4c-1bb4-49de-95c8-7a1de302a2b7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:57.228058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b9390f4c-1bb4-49de-95c8-7a1de302a2b7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:57.229041 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b9390f4c-1bb4-49de-95c8-7a1de302a2b7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:57.229823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b9390f4c-1bb4-49de-95c8-7a1de302a2b7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:57.231075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b9390f4c-1bb4-49de-95c8-7a1de302a2b7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:57.232530 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b9390f4c-1bb4-49de-95c8-7a1de302a2b7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:57.233286 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b9390f4c-1bb4-49de-95c8-7a1de302a2b7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:57.407629 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b9390f4c-1bb4-49de-95c8-7a1de302a2b7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:57.418069 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b9390f4c-1bb4-49de-95c8-7a1de302a2b7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:57.420100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b9390f4c-1bb4-49de-95c8-7a1de302a2b7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:57.421346 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b9390f4c-1bb4-49de-95c8-7a1de302a2b7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.213404 Aug 31 11:52:57.421916 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 555/1108] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:57 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:57.696870 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-37266c5f-deb0-4426-be23-4c9abe53deba req-dd4f7536-b361-453f-a7eb-3106977f91f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a8b816-21a4-4281-b63e-b0800284a77c", "name": "network-vif-plugged", "status": "completed", "tag": "3277ada0-073c-4e05-bad0-cc0a0559d656"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:52:57.711504 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-37266c5f-deb0-4426-be23-4c9abe53deba req-dd4f7536-b361-453f-a7eb-3106977f91f7 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:57.712185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-37266c5f-deb0-4426-be23-4c9abe53deba req-dd4f7536-b361-453f-a7eb-3106977f91f7 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:57.712768 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-37266c5f-deb0-4426-be23-4c9abe53deba req-dd4f7536-b361-453f-a7eb-3106977f91f7 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:57.727168 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-37266c5f-deb0-4426-be23-4c9abe53deba req-dd4f7536-b361-453f-a7eb-3106977f91f7 service nova] Creating event network-vif-plugged:3277ada0-073c-4e05-bad0-cc0a0559d656 for instance f9a8b816-21a4-4281-b63e-b0800284a77c on hv-cinder-83976 Aug 31 11:52:57.733735 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-37266c5f-deb0-4426-be23-4c9abe53deba req-dd4f7536-b361-453f-a7eb-3106977f91f7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053306 Aug 31 11:52:57.734822 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 554/1109] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:52:57.776130 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-88f8dc84-614a-420c-a459-9f0de0f3ae22 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:57.777206 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-88f8dc84-614a-420c-a459-9f0de0f3ae22 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:57.787898 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88f8dc84-614a-420c-a459-9f0de0f3ae22 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:57.788382 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88f8dc84-614a-420c-a459-9f0de0f3ae22 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:57.788848 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88f8dc84-614a-420c-a459-9f0de0f3ae22 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:57.789582 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88f8dc84-614a-420c-a459-9f0de0f3ae22 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:57.790031 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88f8dc84-614a-420c-a459-9f0de0f3ae22 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:57.790453 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-88f8dc84-614a-420c-a459-9f0de0f3ae22 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:58.010048 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-88f8dc84-614a-420c-a459-9f0de0f3ae22 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:58.025935 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-88f8dc84-614a-420c-a459-9f0de0f3ae22 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.254179 Aug 31 11:52:58.026974 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 556/1110] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:57 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:58.446968 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-da4bef04-0a99-4335-98e3-5ede2d4535a4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:58.447766 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-da4bef04-0a99-4335-98e3-5ede2d4535a4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:58.455337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da4bef04-0a99-4335-98e3-5ede2d4535a4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:58.455816 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da4bef04-0a99-4335-98e3-5ede2d4535a4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:58.456250 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da4bef04-0a99-4335-98e3-5ede2d4535a4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:58.456981 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da4bef04-0a99-4335-98e3-5ede2d4535a4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:58.457432 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da4bef04-0a99-4335-98e3-5ede2d4535a4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:58.457852 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da4bef04-0a99-4335-98e3-5ede2d4535a4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:58.591083 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:58.725250 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-da4bef04-0a99-4335-98e3-5ede2d4535a4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:58.737901 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:58.741579 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-da4bef04-0a99-4335-98e3-5ede2d4535a4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:58.743364 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-da4bef04-0a99-4335-98e3-5ede2d4535a4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:58.744851 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-da4bef04-0a99-4335-98e3-5ede2d4535a4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.302322 Aug 31 11:52:58.745737 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 555/1111] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:58 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:52:59.062139 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-df52b179-3d00-42e7-b85b-37b7b963d4af tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:59.063118 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-df52b179-3d00-42e7-b85b-37b7b963d4af tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:59.065228 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:59.065906 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=6 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:52:59.071341 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-df52b179-3d00-42e7-b85b-37b7b963d4af tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:59.072089 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-df52b179-3d00-42e7-b85b-37b7b963d4af tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:59.072783 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-df52b179-3d00-42e7-b85b-37b7b963d4af tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:59.073795 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-df52b179-3d00-42e7-b85b-37b7b963d4af tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:59.074539 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-df52b179-3d00-42e7-b85b-37b7b963d4af tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:59.075629 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-df52b179-3d00-42e7-b85b-37b7b963d4af tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:59.239185 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-df52b179-3d00-42e7-b85b-37b7b963d4af tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:59.247863 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-df52b179-3d00-42e7-b85b-37b7b963d4af tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.189897 Aug 31 11:52:59.248733 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 557/1112] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:52:59 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:52:59.771545 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b48b7d3c-1268-4a37-a747-b6cb4be4c598 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:52:59.772136 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b48b7d3c-1268-4a37-a747-b6cb4be4c598 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:52:59.780120 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b48b7d3c-1268-4a37-a747-b6cb4be4c598 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:59.780655 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b48b7d3c-1268-4a37-a747-b6cb4be4c598 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:59.781090 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b48b7d3c-1268-4a37-a747-b6cb4be4c598 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:59.781801 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b48b7d3c-1268-4a37-a747-b6cb4be4c598 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:52:59.782257 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b48b7d3c-1268-4a37-a747-b6cb4be4c598 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:52:59.782676 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b48b7d3c-1268-4a37-a747-b6cb4be4c598 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:52:59.955275 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b48b7d3c-1268-4a37-a747-b6cb4be4c598 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:59.969930 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b48b7d3c-1268-4a37-a747-b6cb4be4c598 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:59.970937 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b48b7d3c-1268-4a37-a747-b6cb4be4c598 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:52:59.972436 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b48b7d3c-1268-4a37-a747-b6cb4be4c598 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.206171 Aug 31 11:52:59.973051 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 556/1113] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:52:59 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:53:00.269692 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3e9fda90-4ec7-4bff-8724-fca2cb22898e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:00.271132 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3e9fda90-4ec7-4bff-8724-fca2cb22898e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:00.280879 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3e9fda90-4ec7-4bff-8724-fca2cb22898e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:00.281362 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3e9fda90-4ec7-4bff-8724-fca2cb22898e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:00.281811 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3e9fda90-4ec7-4bff-8724-fca2cb22898e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:00.282512 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3e9fda90-4ec7-4bff-8724-fca2cb22898e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:00.282954 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3e9fda90-4ec7-4bff-8724-fca2cb22898e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:00.283368 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3e9fda90-4ec7-4bff-8724-fca2cb22898e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:00.479889 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3e9fda90-4ec7-4bff-8724-fca2cb22898e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:00.493987 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3e9fda90-4ec7-4bff-8724-fca2cb22898e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.228494 Aug 31 11:53:00.494920 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 558/1114] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:00 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:53:00.759675 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c85263f7-b41f-4a27-bf57-280a077c91e4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:00.760165 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c85263f7-b41f-4a27-bf57-280a077c91e4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:00.769204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c85263f7-b41f-4a27-bf57-280a077c91e4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:00.769927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c85263f7-b41f-4a27-bf57-280a077c91e4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:00.770575 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c85263f7-b41f-4a27-bf57-280a077c91e4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:00.771724 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c85263f7-b41f-4a27-bf57-280a077c91e4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:00.772435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c85263f7-b41f-4a27-bf57-280a077c91e4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:00.773202 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c85263f7-b41f-4a27-bf57-280a077c91e4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:00.804899 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c85263f7-b41f-4a27-bf57-280a077c91e4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/ips" status: 200 len: 145 microversion: 2.1 time: 0.050225 Aug 31 11:53:00.805455 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 557/1115] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 31 11:53:00 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:53:01.001760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-181e850c-3721-438e-88b9-dcc977f55a66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:01.002760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-181e850c-3721-438e-88b9-dcc977f55a66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:01.009703 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-181e850c-3721-438e-88b9-dcc977f55a66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:01.010316 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-181e850c-3721-438e-88b9-dcc977f55a66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:01.011022 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-181e850c-3721-438e-88b9-dcc977f55a66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:01.011944 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-181e850c-3721-438e-88b9-dcc977f55a66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:01.012599 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-181e850c-3721-438e-88b9-dcc977f55a66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:01.013057 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-181e850c-3721-438e-88b9-dcc977f55a66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:01.250149 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-181e850c-3721-438e-88b9-dcc977f55a66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:01.271733 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-181e850c-3721-438e-88b9-dcc977f55a66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:01.275928 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-181e850c-3721-438e-88b9-dcc977f55a66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:01.286696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-181e850c-3721-438e-88b9-dcc977f55a66 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.279765 Aug 31 11:53:01.287391 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 559/1116] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:00 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:53:01.519459 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-520f93c3-b487-4a9a-99fe-bd0bde4c2385 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:01.520839 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-520f93c3-b487-4a9a-99fe-bd0bde4c2385 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:01.528913 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-520f93c3-b487-4a9a-99fe-bd0bde4c2385 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:01.529900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-520f93c3-b487-4a9a-99fe-bd0bde4c2385 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:01.531025 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-520f93c3-b487-4a9a-99fe-bd0bde4c2385 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:01.532215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-520f93c3-b487-4a9a-99fe-bd0bde4c2385 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:01.532847 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-520f93c3-b487-4a9a-99fe-bd0bde4c2385 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:01.533695 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-520f93c3-b487-4a9a-99fe-bd0bde4c2385 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:01.730181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-520f93c3-b487-4a9a-99fe-bd0bde4c2385 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:01.742246 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-520f93c3-b487-4a9a-99fe-bd0bde4c2385 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.226605 Aug 31 11:53:01.743222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 558/1117] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:01 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:53:02.270776 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e2a127cc-fe4f-464c-bcc3-b674704716c7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "279af38d-8df2-49c4-8441-817327794b9c"}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:53:02.274128 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e2a127cc-fe4f-464c-bcc3-b674704716c7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:02.284697 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e2a127cc-fe4f-464c-bcc3-b674704716c7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:02.285191 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e2a127cc-fe4f-464c-bcc3-b674704716c7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:02.285628 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e2a127cc-fe4f-464c-bcc3-b674704716c7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:02.286384 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e2a127cc-fe4f-464c-bcc3-b674704716c7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:02.287070 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e2a127cc-fe4f-464c-bcc3-b674704716c7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:02.287752 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e2a127cc-fe4f-464c-bcc3-b674704716c7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:02.315479 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-dcf95d20-289f-4065-9b3f-65bc0535a0bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:02.316769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-dcf95d20-289f-4065-9b3f-65bc0535a0bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:02.325211 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dcf95d20-289f-4065-9b3f-65bc0535a0bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:02.326645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dcf95d20-289f-4065-9b3f-65bc0535a0bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:02.327596 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dcf95d20-289f-4065-9b3f-65bc0535a0bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:02.328951 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dcf95d20-289f-4065-9b3f-65bc0535a0bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:02.329587 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dcf95d20-289f-4065-9b3f-65bc0535a0bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:02.330302 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dcf95d20-289f-4065-9b3f-65bc0535a0bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:02.515548 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-dcf95d20-289f-4065-9b3f-65bc0535a0bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:02.526335 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-dcf95d20-289f-4065-9b3f-65bc0535a0bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:02.528784 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-dcf95d20-289f-4065-9b3f-65bc0535a0bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:02.530424 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-dcf95d20-289f-4065-9b3f-65bc0535a0bb tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.221012 Aug 31 11:53:02.530996 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 559/1118] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:02 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:53:02.766805 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-da2de635-0316-44f7-a1e5-3d9e7cd6fa3e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:02.767327 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-da2de635-0316-44f7-a1e5-3d9e7cd6fa3e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:02.774226 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da2de635-0316-44f7-a1e5-3d9e7cd6fa3e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:02.774767 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da2de635-0316-44f7-a1e5-3d9e7cd6fa3e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:02.775210 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da2de635-0316-44f7-a1e5-3d9e7cd6fa3e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:02.775965 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da2de635-0316-44f7-a1e5-3d9e7cd6fa3e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:02.776744 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da2de635-0316-44f7-a1e5-3d9e7cd6fa3e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:02.777190 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da2de635-0316-44f7-a1e5-3d9e7cd6fa3e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:02.960580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-da2de635-0316-44f7-a1e5-3d9e7cd6fa3e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:02.970605 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-da2de635-0316-44f7-a1e5-3d9e7cd6fa3e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.208819 Aug 31 11:53:02.971402 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 560/1119] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:02 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:53:03.555679 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d8b9ae6a-80e9-499d-9d1a-f58c27957ce0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:03.556911 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d8b9ae6a-80e9-499d-9d1a-f58c27957ce0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:03.566568 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8b9ae6a-80e9-499d-9d1a-f58c27957ce0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:03.567140 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8b9ae6a-80e9-499d-9d1a-f58c27957ce0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:03.567577 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8b9ae6a-80e9-499d-9d1a-f58c27957ce0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:03.568325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8b9ae6a-80e9-499d-9d1a-f58c27957ce0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:03.568785 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8b9ae6a-80e9-499d-9d1a-f58c27957ce0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:03.569207 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8b9ae6a-80e9-499d-9d1a-f58c27957ce0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:03.766492 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d8b9ae6a-80e9-499d-9d1a-f58c27957ce0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:03.779361 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d8b9ae6a-80e9-499d-9d1a-f58c27957ce0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:03.780955 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d8b9ae6a-80e9-499d-9d1a-f58c27957ce0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:03.782718 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d8b9ae6a-80e9-499d-9d1a-f58c27957ce0 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.231240 Aug 31 11:53:03.788232 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 561/1120] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:03 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:53:03.999505 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-04ed2b7d-b8a8-4b3e-b2b3-e0c33029414e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:04.000452 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-04ed2b7d-b8a8-4b3e-b2b3-e0c33029414e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:04.013170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-04ed2b7d-b8a8-4b3e-b2b3-e0c33029414e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:04.013671 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-04ed2b7d-b8a8-4b3e-b2b3-e0c33029414e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:04.014127 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-04ed2b7d-b8a8-4b3e-b2b3-e0c33029414e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:04.016281 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-04ed2b7d-b8a8-4b3e-b2b3-e0c33029414e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:04.016943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-04ed2b7d-b8a8-4b3e-b2b3-e0c33029414e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:04.018164 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-04ed2b7d-b8a8-4b3e-b2b3-e0c33029414e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:04.181801 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-04ed2b7d-b8a8-4b3e-b2b3-e0c33029414e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:04.191587 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-04ed2b7d-b8a8-4b3e-b2b3-e0c33029414e tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.198404 Aug 31 11:53:04.192446 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 562/1121] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:03 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:53:04.807164 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-efaab649-f80b-4db0-8381-25e5f88fc21a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:04.807966 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-efaab649-f80b-4db0-8381-25e5f88fc21a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:04.818556 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-efaab649-f80b-4db0-8381-25e5f88fc21a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:04.818920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-efaab649-f80b-4db0-8381-25e5f88fc21a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:04.819727 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-efaab649-f80b-4db0-8381-25e5f88fc21a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:04.820562 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-efaab649-f80b-4db0-8381-25e5f88fc21a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:04.821046 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-efaab649-f80b-4db0-8381-25e5f88fc21a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:04.821476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-efaab649-f80b-4db0-8381-25e5f88fc21a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:04.984716 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-efaab649-f80b-4db0-8381-25e5f88fc21a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:04.993561 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-efaab649-f80b-4db0-8381-25e5f88fc21a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:04.995015 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-efaab649-f80b-4db0-8381-25e5f88fc21a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:04.998337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-efaab649-f80b-4db0-8381-25e5f88fc21a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.193142 Aug 31 11:53:04.998337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 563/1122] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:04 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:53:05.214230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c367326b-0ea0-41ee-af06-7e15723d3025 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:05.214752 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c367326b-0ea0-41ee-af06-7e15723d3025 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:05.221721 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c367326b-0ea0-41ee-af06-7e15723d3025 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:05.222213 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c367326b-0ea0-41ee-af06-7e15723d3025 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:05.222651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c367326b-0ea0-41ee-af06-7e15723d3025 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:05.223416 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c367326b-0ea0-41ee-af06-7e15723d3025 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:05.223859 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c367326b-0ea0-41ee-af06-7e15723d3025 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:05.224282 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c367326b-0ea0-41ee-af06-7e15723d3025 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:05.387038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c367326b-0ea0-41ee-af06-7e15723d3025 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:05.396986 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c367326b-0ea0-41ee-af06-7e15723d3025 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.186819 Aug 31 11:53:05.408925 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 564/1123] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:05 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:53:06.020533 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5a77ff0e-84f6-4503-9f7f-6953325a21ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:06.021988 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5a77ff0e-84f6-4503-9f7f-6953325a21ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:06.029180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a77ff0e-84f6-4503-9f7f-6953325a21ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:06.029842 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a77ff0e-84f6-4503-9f7f-6953325a21ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:06.030307 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a77ff0e-84f6-4503-9f7f-6953325a21ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:06.031032 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a77ff0e-84f6-4503-9f7f-6953325a21ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:06.031491 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a77ff0e-84f6-4503-9f7f-6953325a21ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:06.031923 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5a77ff0e-84f6-4503-9f7f-6953325a21ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:06.204818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5a77ff0e-84f6-4503-9f7f-6953325a21ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:06.215343 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5a77ff0e-84f6-4503-9f7f-6953325a21ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:06.217034 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5a77ff0e-84f6-4503-9f7f-6953325a21ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:06.218251 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5a77ff0e-84f6-4503-9f7f-6953325a21ea tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.202404 Aug 31 11:53:06.218864 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 565/1124] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:06 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:53:06.417640 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5c64a97b-ecdd-4b09-bee7-0f2e48dc26b4 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:06.418698 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5c64a97b-ecdd-4b09-bee7-0f2e48dc26b4 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:06.425110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5c64a97b-ecdd-4b09-bee7-0f2e48dc26b4 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:06.425720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5c64a97b-ecdd-4b09-bee7-0f2e48dc26b4 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:06.426780 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5c64a97b-ecdd-4b09-bee7-0f2e48dc26b4 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:06.427096 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5c64a97b-ecdd-4b09-bee7-0f2e48dc26b4 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:06.427699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5c64a97b-ecdd-4b09-bee7-0f2e48dc26b4 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:06.428163 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5c64a97b-ecdd-4b09-bee7-0f2e48dc26b4 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:06.607522 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5c64a97b-ecdd-4b09-bee7-0f2e48dc26b4 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:06.616390 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5c64a97b-ecdd-4b09-bee7-0f2e48dc26b4 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.202627 Aug 31 11:53:06.617030 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 566/1125] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:06 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:53:07.425398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2a328958-31cc-4158-87a4-d87ff3f07259 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:07.426068 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2a328958-31cc-4158-87a4-d87ff3f07259 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:07.438103 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2a328958-31cc-4158-87a4-d87ff3f07259 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:07.438609 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2a328958-31cc-4158-87a4-d87ff3f07259 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:07.439034 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2a328958-31cc-4158-87a4-d87ff3f07259 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:07.439731 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2a328958-31cc-4158-87a4-d87ff3f07259 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:07.440245 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2a328958-31cc-4158-87a4-d87ff3f07259 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:07.440681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2a328958-31cc-4158-87a4-d87ff3f07259 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:07.608591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2a328958-31cc-4158-87a4-d87ff3f07259 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:07.617047 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2a328958-31cc-4158-87a4-d87ff3f07259 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:07.618523 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2a328958-31cc-4158-87a4-d87ff3f07259 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:07.619715 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2a328958-31cc-4158-87a4-d87ff3f07259 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.382458 Aug 31 11:53:07.620285 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 567/1126] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:07 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:53:07.639563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8d4679d5-25d2-4b3b-b4d8-1ff288c1af3f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:07.640181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8d4679d5-25d2-4b3b-b4d8-1ff288c1af3f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:07.646415 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8d4679d5-25d2-4b3b-b4d8-1ff288c1af3f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:07.646884 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8d4679d5-25d2-4b3b-b4d8-1ff288c1af3f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:07.647323 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8d4679d5-25d2-4b3b-b4d8-1ff288c1af3f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:07.648703 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8d4679d5-25d2-4b3b-b4d8-1ff288c1af3f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:07.648703 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8d4679d5-25d2-4b3b-b4d8-1ff288c1af3f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:07.648934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8d4679d5-25d2-4b3b-b4d8-1ff288c1af3f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:07.802756 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8d4679d5-25d2-4b3b-b4d8-1ff288c1af3f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:07.811307 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8d4679d5-25d2-4b3b-b4d8-1ff288c1af3f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.177281 Aug 31 11:53:07.811892 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 568/1127] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:07 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:53:08.644365 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ca5d0f97-9f04-4e29-8186-1efb9669daba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:08.645070 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ca5d0f97-9f04-4e29-8186-1efb9669daba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:08.651685 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca5d0f97-9f04-4e29-8186-1efb9669daba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:08.652167 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca5d0f97-9f04-4e29-8186-1efb9669daba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:08.652637 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca5d0f97-9f04-4e29-8186-1efb9669daba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:08.653381 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca5d0f97-9f04-4e29-8186-1efb9669daba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:08.653836 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca5d0f97-9f04-4e29-8186-1efb9669daba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:08.654256 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca5d0f97-9f04-4e29-8186-1efb9669daba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:08.800069 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ca5d0f97-9f04-4e29-8186-1efb9669daba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:08.810227 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ca5d0f97-9f04-4e29-8186-1efb9669daba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:08.811680 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ca5d0f97-9f04-4e29-8186-1efb9669daba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:08.813143 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ca5d0f97-9f04-4e29-8186-1efb9669daba tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.173098 Aug 31 11:53:08.813724 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 569/1128] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:08 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:53:08.832325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4b3b549c-02da-464c-9f7d-e9d56ad4b77d tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:08.832972 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4b3b549c-02da-464c-9f7d-e9d56ad4b77d tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:08.839174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4b3b549c-02da-464c-9f7d-e9d56ad4b77d tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:08.839659 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4b3b549c-02da-464c-9f7d-e9d56ad4b77d tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:08.840092 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4b3b549c-02da-464c-9f7d-e9d56ad4b77d tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:08.840912 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4b3b549c-02da-464c-9f7d-e9d56ad4b77d tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:08.841362 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4b3b549c-02da-464c-9f7d-e9d56ad4b77d tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:08.841839 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4b3b549c-02da-464c-9f7d-e9d56ad4b77d tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:08.989532 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4b3b549c-02da-464c-9f7d-e9d56ad4b77d tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:08.998083 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4b3b549c-02da-464c-9f7d-e9d56ad4b77d tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.169564 Aug 31 11:53:08.998678 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 570/1129] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:08 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:53:09.835810 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-12be074c-dcd7-4095-8dc5-4504b7df96c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:09.836530 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-12be074c-dcd7-4095-8dc5-4504b7df96c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:09.843693 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-12be074c-dcd7-4095-8dc5-4504b7df96c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:09.844177 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-12be074c-dcd7-4095-8dc5-4504b7df96c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:09.844643 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-12be074c-dcd7-4095-8dc5-4504b7df96c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:09.845351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-12be074c-dcd7-4095-8dc5-4504b7df96c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:09.845829 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-12be074c-dcd7-4095-8dc5-4504b7df96c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:09.846254 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-12be074c-dcd7-4095-8dc5-4504b7df96c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:10.006107 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-12be074c-dcd7-4095-8dc5-4504b7df96c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:10.015647 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-12be074c-dcd7-4095-8dc5-4504b7df96c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:10.018330 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-12be074c-dcd7-4095-8dc5-4504b7df96c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:10.018330 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-12be074c-dcd7-4095-8dc5-4504b7df96c4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.186450 Aug 31 11:53:10.018861 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 571/1130] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:09 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:53:10.023403 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-88e18416-1686-4aba-890d-2948a96ba056 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:10.023995 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-88e18416-1686-4aba-890d-2948a96ba056 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:10.031018 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88e18416-1686-4aba-890d-2948a96ba056 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:10.032328 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88e18416-1686-4aba-890d-2948a96ba056 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:10.032328 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88e18416-1686-4aba-890d-2948a96ba056 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:10.032627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88e18416-1686-4aba-890d-2948a96ba056 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:10.033069 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88e18416-1686-4aba-890d-2948a96ba056 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:10.033498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-88e18416-1686-4aba-890d-2948a96ba056 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:10.176319 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-88e18416-1686-4aba-890d-2948a96ba056 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:10.179749 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=100 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:53:10.185987 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-88e18416-1686-4aba-890d-2948a96ba056 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.166109 Aug 31 11:53:10.186571 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 572/1131] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:10 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:53:11.041689 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-76c5c5c4-a319-4119-9f9d-9d933562b286 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:11.042345 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-76c5c5c4-a319-4119-9f9d-9d933562b286 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:11.049584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76c5c5c4-a319-4119-9f9d-9d933562b286 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:11.050081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76c5c5c4-a319-4119-9f9d-9d933562b286 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:11.050516 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76c5c5c4-a319-4119-9f9d-9d933562b286 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:11.051228 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76c5c5c4-a319-4119-9f9d-9d933562b286 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:11.051683 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76c5c5c4-a319-4119-9f9d-9d933562b286 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:11.052109 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-76c5c5c4-a319-4119-9f9d-9d933562b286 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:11.231277 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-76c5c5c4-a319-4119-9f9d-9d933562b286 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:11.240668 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-76c5c5c4-a319-4119-9f9d-9d933562b286 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:11.242127 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-76c5c5c4-a319-4119-9f9d-9d933562b286 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:11.243343 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-76c5c5c4-a319-4119-9f9d-9d933562b286 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.205997 Aug 31 11:53:11.243919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 573/1132] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:11 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:53:11.249791 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9fc54b5a-be58-450f-9af1-9f11335db9d5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:11.250402 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9fc54b5a-be58-450f-9af1-9f11335db9d5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:11.256584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fc54b5a-be58-450f-9af1-9f11335db9d5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:11.257068 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fc54b5a-be58-450f-9af1-9f11335db9d5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:11.257519 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fc54b5a-be58-450f-9af1-9f11335db9d5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:11.258231 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fc54b5a-be58-450f-9af1-9f11335db9d5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:11.258680 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fc54b5a-be58-450f-9af1-9f11335db9d5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:11.259106 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9fc54b5a-be58-450f-9af1-9f11335db9d5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:11.406542 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9fc54b5a-be58-450f-9af1-9f11335db9d5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:11.414531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9fc54b5a-be58-450f-9af1-9f11335db9d5 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.169512 Aug 31 11:53:11.415120 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 574/1133] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:11 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:53:12.268001 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2e8055ca-89a5-4af9-9f8e-16e53ce7cd62 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:12.268710 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2e8055ca-89a5-4af9-9f8e-16e53ce7cd62 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:12.271038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:53:12.278881 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2e8055ca-89a5-4af9-9f8e-16e53ce7cd62 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:12.280117 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2e8055ca-89a5-4af9-9f8e-16e53ce7cd62 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:12.280768 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2e8055ca-89a5-4af9-9f8e-16e53ce7cd62 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:12.281604 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2e8055ca-89a5-4af9-9f8e-16e53ce7cd62 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:12.281974 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:53:12.283891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2e8055ca-89a5-4af9-9f8e-16e53ce7cd62 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:12.283891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2e8055ca-89a5-4af9-9f8e-16e53ce7cd62 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:12.415021 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:53:12.469734 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2e8055ca-89a5-4af9-9f8e-16e53ce7cd62 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:12.479091 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2e8055ca-89a5-4af9-9f8e-16e53ce7cd62 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:12.482521 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2e8055ca-89a5-4af9-9f8e-16e53ce7cd62 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:12.482521 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2e8055ca-89a5-4af9-9f8e-16e53ce7cd62 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.218320 Aug 31 11:53:12.482870 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 575/1134] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:12 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:53:12.487759 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9afb27fe-62cb-4e25-8f60-f1fce55a2bdc tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:12.488367 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9afb27fe-62cb-4e25-8f60-f1fce55a2bdc tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:12.494609 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9afb27fe-62cb-4e25-8f60-f1fce55a2bdc tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:12.494999 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9afb27fe-62cb-4e25-8f60-f1fce55a2bdc tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:12.495460 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9afb27fe-62cb-4e25-8f60-f1fce55a2bdc tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:12.496150 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9afb27fe-62cb-4e25-8f60-f1fce55a2bdc tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:12.496801 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9afb27fe-62cb-4e25-8f60-f1fce55a2bdc tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:12.497518 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9afb27fe-62cb-4e25-8f60-f1fce55a2bdc tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:12.645735 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9afb27fe-62cb-4e25-8f60-f1fce55a2bdc tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:12.654232 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9afb27fe-62cb-4e25-8f60-f1fce55a2bdc tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.170375 Aug 31 11:53:12.654801 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 576/1135] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:12 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:53:13.506683 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4e59bb3e-4aa7-45f8-bdc1-8e907668f508 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:13.507786 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4e59bb3e-4aa7-45f8-bdc1-8e907668f508 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:13.515949 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4e59bb3e-4aa7-45f8-bdc1-8e907668f508 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:13.516582 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4e59bb3e-4aa7-45f8-bdc1-8e907668f508 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:13.517191 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4e59bb3e-4aa7-45f8-bdc1-8e907668f508 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:13.517997 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4e59bb3e-4aa7-45f8-bdc1-8e907668f508 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:13.518629 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4e59bb3e-4aa7-45f8-bdc1-8e907668f508 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:13.519122 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4e59bb3e-4aa7-45f8-bdc1-8e907668f508 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:13.596530 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e2a127cc-fe4f-464c-bcc3-b674704716c7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "POST /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.328180 Aug 31 11:53:13.596530 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 560/1136] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 31 11:53:02 2022] POST /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments => generated 194 bytes in 11330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:53:13.685512 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c89f75e5-6aa8-4729-af51-1ff46140b3e6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:13.689827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c89f75e5-6aa8-4729-af51-1ff46140b3e6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:13.696864 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c89f75e5-6aa8-4729-af51-1ff46140b3e6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:13.697653 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c89f75e5-6aa8-4729-af51-1ff46140b3e6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:13.698264 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c89f75e5-6aa8-4729-af51-1ff46140b3e6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:13.699145 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c89f75e5-6aa8-4729-af51-1ff46140b3e6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:13.699629 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c89f75e5-6aa8-4729-af51-1ff46140b3e6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:13.700049 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c89f75e5-6aa8-4729-af51-1ff46140b3e6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:13.781789 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4e59bb3e-4aa7-45f8-bdc1-8e907668f508 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:13.790257 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4e59bb3e-4aa7-45f8-bdc1-8e907668f508 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:13.791772 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4e59bb3e-4aa7-45f8-bdc1-8e907668f508 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:13.793031 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4e59bb3e-4aa7-45f8-bdc1-8e907668f508 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.291376 Aug 31 11:53:13.795102 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 577/1137] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:13 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:53:13.866393 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c89f75e5-6aa8-4729-af51-1ff46140b3e6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:13.875094 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c89f75e5-6aa8-4729-af51-1ff46140b3e6 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.203101 Aug 31 11:53:13.875673 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 561/1138] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:13 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:53:14.822921 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ec18c1a6-02de-4e6d-abd4-9c90e109eec1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:14.823538 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ec18c1a6-02de-4e6d-abd4-9c90e109eec1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:14.830590 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ec18c1a6-02de-4e6d-abd4-9c90e109eec1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:14.831069 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ec18c1a6-02de-4e6d-abd4-9c90e109eec1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:14.831498 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ec18c1a6-02de-4e6d-abd4-9c90e109eec1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:14.832194 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ec18c1a6-02de-4e6d-abd4-9c90e109eec1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:14.832674 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ec18c1a6-02de-4e6d-abd4-9c90e109eec1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:14.833095 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ec18c1a6-02de-4e6d-abd4-9c90e109eec1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:14.895886 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-929d1144-5466-435f-bd52-c384b1186c99 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:14.896584 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-929d1144-5466-435f-bd52-c384b1186c99 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:14.904159 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-929d1144-5466-435f-bd52-c384b1186c99 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:14.904667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-929d1144-5466-435f-bd52-c384b1186c99 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:14.905156 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-929d1144-5466-435f-bd52-c384b1186c99 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:14.905918 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-929d1144-5466-435f-bd52-c384b1186c99 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:14.906373 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-929d1144-5466-435f-bd52-c384b1186c99 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:14.906837 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-929d1144-5466-435f-bd52-c384b1186c99 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:14.983631 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ec18c1a6-02de-4e6d-abd4-9c90e109eec1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:14.992706 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ec18c1a6-02de-4e6d-abd4-9c90e109eec1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:14.994161 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ec18c1a6-02de-4e6d-abd4-9c90e109eec1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:14.995346 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ec18c1a6-02de-4e6d-abd4-9c90e109eec1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.176608 Aug 31 11:53:14.995911 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 578/1139] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:14 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:53:15.064468 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-929d1144-5466-435f-bd52-c384b1186c99 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:15.075827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-929d1144-5466-435f-bd52-c384b1186c99 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1313 microversion: 2.1 time: 0.184172 Aug 31 11:53:15.076931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 562/1140] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:14 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:53:15.708753 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-742fdf7b-1c9f-4f9b-b50c-205422666bd7 req-b4aca4fc-823a-4c33-94a0-1a379fab8270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06aad3ea-8a4f-44c5-829c-b0230807fdf7", "name": "network-vif-plugged", "status": "completed", "tag": "936e8033-671c-4a3d-9abe-a63045a10877"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:53:15.719655 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-742fdf7b-1c9f-4f9b-b50c-205422666bd7 req-b4aca4fc-823a-4c33-94a0-1a379fab8270 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:15.720138 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-742fdf7b-1c9f-4f9b-b50c-205422666bd7 req-b4aca4fc-823a-4c33-94a0-1a379fab8270 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:15.720634 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-742fdf7b-1c9f-4f9b-b50c-205422666bd7 req-b4aca4fc-823a-4c33-94a0-1a379fab8270 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:15.734391 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-742fdf7b-1c9f-4f9b-b50c-205422666bd7 req-b4aca4fc-823a-4c33-94a0-1a379fab8270 service nova] Creating event network-vif-plugged:936e8033-671c-4a3d-9abe-a63045a10877 for instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 on hv-cinder-83976 Aug 31 11:53:15.739485 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-742fdf7b-1c9f-4f9b-b50c-205422666bd7 req-b4aca4fc-823a-4c33-94a0-1a379fab8270 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034550 Aug 31 11:53:15.740085 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 579/1141] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:53:16.019481 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-56ebb96a-c0a9-4df5-bc0f-097bf8019cb6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:16.020099 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-56ebb96a-c0a9-4df5-bc0f-097bf8019cb6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:16.026861 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56ebb96a-c0a9-4df5-bc0f-097bf8019cb6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:16.027344 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56ebb96a-c0a9-4df5-bc0f-097bf8019cb6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:16.028711 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56ebb96a-c0a9-4df5-bc0f-097bf8019cb6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:16.029452 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56ebb96a-c0a9-4df5-bc0f-097bf8019cb6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:16.029884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56ebb96a-c0a9-4df5-bc0f-097bf8019cb6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:16.030313 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56ebb96a-c0a9-4df5-bc0f-097bf8019cb6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:16.101911 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6ca901b4-c92d-4b54-80b2-2352eb21afa1 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:16.102707 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6ca901b4-c92d-4b54-80b2-2352eb21afa1 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:16.109867 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6ca901b4-c92d-4b54-80b2-2352eb21afa1 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:16.110487 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6ca901b4-c92d-4b54-80b2-2352eb21afa1 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:16.110926 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6ca901b4-c92d-4b54-80b2-2352eb21afa1 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:16.111660 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6ca901b4-c92d-4b54-80b2-2352eb21afa1 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:16.112111 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6ca901b4-c92d-4b54-80b2-2352eb21afa1 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:16.112566 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6ca901b4-c92d-4b54-80b2-2352eb21afa1 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:16.179775 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-56ebb96a-c0a9-4df5-bc0f-097bf8019cb6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:16.189128 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-56ebb96a-c0a9-4df5-bc0f-097bf8019cb6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:16.190694 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-56ebb96a-c0a9-4df5-bc0f-097bf8019cb6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:16.191973 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-56ebb96a-c0a9-4df5-bc0f-097bf8019cb6 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.176596 Aug 31 11:53:16.192561 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 563/1142] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:16 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:53:16.258713 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6ca901b4-c92d-4b54-80b2-2352eb21afa1 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:16.267569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6ca901b4-c92d-4b54-80b2-2352eb21afa1 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1497 microversion: 2.1 time: 0.171704 Aug 31 11:53:16.268150 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 580/1143] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:16 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:53:16.737156 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9ac3a563-85a2-4058-92e3-2db32adbf91f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:16.737648 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9ac3a563-85a2-4058-92e3-2db32adbf91f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:16.743578 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9ac3a563-85a2-4058-92e3-2db32adbf91f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:16.744056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9ac3a563-85a2-4058-92e3-2db32adbf91f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:16.744521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9ac3a563-85a2-4058-92e3-2db32adbf91f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:16.745198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9ac3a563-85a2-4058-92e3-2db32adbf91f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:16.745646 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9ac3a563-85a2-4058-92e3-2db32adbf91f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:16.746065 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9ac3a563-85a2-4058-92e3-2db32adbf91f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:16.773109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9ac3a563-85a2-4058-92e3-2db32adbf91f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Going to try to terminate instance {{(pid=127061) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:53:16.856651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9ac3a563-85a2-4058-92e3-2db32adbf91f tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 204 len: 0 microversion: 2.1 time: 0.122414 Aug 31 11:53:16.857284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 564/1144] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:53:16 2022] DELETE /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:53:16.865412 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5107e119-9a71-4b79-aa6a-9edb603933c3 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:16.866021 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5107e119-9a71-4b79-aa6a-9edb603933c3 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:16.873478 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5107e119-9a71-4b79-aa6a-9edb603933c3 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:16.873979 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5107e119-9a71-4b79-aa6a-9edb603933c3 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:16.874546 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5107e119-9a71-4b79-aa6a-9edb603933c3 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:16.875284 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5107e119-9a71-4b79-aa6a-9edb603933c3 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:16.875905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5107e119-9a71-4b79-aa6a-9edb603933c3 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:16.876328 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5107e119-9a71-4b79-aa6a-9edb603933c3 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:17.019834 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5107e119-9a71-4b79-aa6a-9edb603933c3 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:17.028762 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5107e119-9a71-4b79-aa6a-9edb603933c3 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1503 microversion: 2.1 time: 0.166237 Aug 31 11:53:17.029279 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 581/1145] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:16 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:53:17.216402 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8554ae2e-e316-4f2a-99fe-de2288e9aea7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:17.217115 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8554ae2e-e316-4f2a-99fe-de2288e9aea7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:17.223663 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8554ae2e-e316-4f2a-99fe-de2288e9aea7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:17.224145 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8554ae2e-e316-4f2a-99fe-de2288e9aea7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:17.224596 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8554ae2e-e316-4f2a-99fe-de2288e9aea7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:17.225293 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8554ae2e-e316-4f2a-99fe-de2288e9aea7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:17.225733 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8554ae2e-e316-4f2a-99fe-de2288e9aea7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:17.226148 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8554ae2e-e316-4f2a-99fe-de2288e9aea7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:17.363680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8554ae2e-e316-4f2a-99fe-de2288e9aea7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:17.372540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8554ae2e-e316-4f2a-99fe-de2288e9aea7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:17.374021 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8554ae2e-e316-4f2a-99fe-de2288e9aea7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:17.375220 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8554ae2e-e316-4f2a-99fe-de2288e9aea7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.163130 Aug 31 11:53:17.375785 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 565/1146] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:17 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:53:18.050607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d0ebbee3-ca78-4424-93d3-c965cbd3cec0 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:18.051209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d0ebbee3-ca78-4424-93d3-c965cbd3cec0 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:18.057885 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d0ebbee3-ca78-4424-93d3-c965cbd3cec0 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:18.058483 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d0ebbee3-ca78-4424-93d3-c965cbd3cec0 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:18.059097 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d0ebbee3-ca78-4424-93d3-c965cbd3cec0 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:18.059837 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d0ebbee3-ca78-4424-93d3-c965cbd3cec0 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:18.060436 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d0ebbee3-ca78-4424-93d3-c965cbd3cec0 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:18.060887 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d0ebbee3-ca78-4424-93d3-c965cbd3cec0 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:18.224867 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d0ebbee3-ca78-4424-93d3-c965cbd3cec0 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:18.233400 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d0ebbee3-ca78-4424-93d3-c965cbd3cec0 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1503 microversion: 2.1 time: 0.186604 Aug 31 11:53:18.234162 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 582/1147] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:18 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:53:18.398594 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-51ccfbdc-0ae3-4e18-a167-ffa3c94b5ba1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:18.399230 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-51ccfbdc-0ae3-4e18-a167-ffa3c94b5ba1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:18.406642 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-51ccfbdc-0ae3-4e18-a167-ffa3c94b5ba1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:18.407691 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-51ccfbdc-0ae3-4e18-a167-ffa3c94b5ba1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:18.408213 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-51ccfbdc-0ae3-4e18-a167-ffa3c94b5ba1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:18.409144 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-51ccfbdc-0ae3-4e18-a167-ffa3c94b5ba1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:18.409600 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-51ccfbdc-0ae3-4e18-a167-ffa3c94b5ba1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:18.410025 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-51ccfbdc-0ae3-4e18-a167-ffa3c94b5ba1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:18.555555 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-51ccfbdc-0ae3-4e18-a167-ffa3c94b5ba1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:18.564684 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-51ccfbdc-0ae3-4e18-a167-ffa3c94b5ba1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:18.566145 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-51ccfbdc-0ae3-4e18-a167-ffa3c94b5ba1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:18.567314 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-51ccfbdc-0ae3-4e18-a167-ffa3c94b5ba1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1732 microversion: 2.20 time: 0.172750 Aug 31 11:53:18.567901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 566/1148] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:18 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:53:19.234851 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-9d75cb21-c082-4985-a3a2-e2b7a5796fe1 req-6b853c6e-3442-42cb-add5-4913a42335ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a8b816-21a4-4281-b63e-b0800284a77c", "name": "network-vif-deleted", "tag": "3277ada0-073c-4e05-bad0-cc0a0559d656"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:53:19.246049 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-9d75cb21-c082-4985-a3a2-e2b7a5796fe1 req-6b853c6e-3442-42cb-add5-4913a42335ad service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:19.246651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-9d75cb21-c082-4985-a3a2-e2b7a5796fe1 req-6b853c6e-3442-42cb-add5-4913a42335ad service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:19.247095 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-9d75cb21-c082-4985-a3a2-e2b7a5796fe1 req-6b853c6e-3442-42cb-add5-4913a42335ad service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:19.259354 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-9d75cb21-c082-4985-a3a2-e2b7a5796fe1 req-6b853c6e-3442-42cb-add5-4913a42335ad service nova] Creating event network-vif-deleted:3277ada0-073c-4e05-bad0-cc0a0559d656 for instance f9a8b816-21a4-4281-b63e-b0800284a77c on hv-cinder-83976 Aug 31 11:53:19.262745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-510473eb-0924-4854-a6ca-4ef9d5773a96 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:19.263929 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-510473eb-0924-4854-a6ca-4ef9d5773a96 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:19.264940 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-9d75cb21-c082-4985-a3a2-e2b7a5796fe1 req-6b853c6e-3442-42cb-add5-4913a42335ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034820 Aug 31 11:53:19.265794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 583/1149] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:53:19.270927 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-510473eb-0924-4854-a6ca-4ef9d5773a96 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:19.271473 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-510473eb-0924-4854-a6ca-4ef9d5773a96 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:19.271918 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-510473eb-0924-4854-a6ca-4ef9d5773a96 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:19.272693 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-510473eb-0924-4854-a6ca-4ef9d5773a96 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:19.273217 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-510473eb-0924-4854-a6ca-4ef9d5773a96 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:19.273578 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-510473eb-0924-4854-a6ca-4ef9d5773a96 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:19.344660 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-510473eb-0924-4854-a6ca-4ef9d5773a96 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea03ffe5a78e4741a47aa8087db14053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbfe7ba453b472ba09b554b59d79281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:19.352737 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-510473eb-0924-4854-a6ca-4ef9d5773a96 tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 200 len: 1298 microversion: 2.1 time: 0.095628 Aug 31 11:53:19.353319 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 567/1150] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:19 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:53:19.592001 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b3a611a5-4e10-47f7-bf4e-c11773c29b17 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:19.592764 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b3a611a5-4e10-47f7-bf4e-c11773c29b17 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:19.599058 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3a611a5-4e10-47f7-bf4e-c11773c29b17 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:19.599544 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3a611a5-4e10-47f7-bf4e-c11773c29b17 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:19.599972 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3a611a5-4e10-47f7-bf4e-c11773c29b17 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:19.600709 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3a611a5-4e10-47f7-bf4e-c11773c29b17 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:19.601159 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3a611a5-4e10-47f7-bf4e-c11773c29b17 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:19.601585 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3a611a5-4e10-47f7-bf4e-c11773c29b17 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:19.736174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b3a611a5-4e10-47f7-bf4e-c11773c29b17 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:19.744395 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b3a611a5-4e10-47f7-bf4e-c11773c29b17 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:19.745872 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b3a611a5-4e10-47f7-bf4e-c11773c29b17 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:19.747782 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b3a611a5-4e10-47f7-bf4e-c11773c29b17 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1719 microversion: 2.20 time: 0.161302 Aug 31 11:53:19.748352 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 584/1151] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:53:19 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:53:20.434063 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0a570f3a-eda8-4114-95db-28ba77019caf tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:20.434668 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-0a570f3a-eda8-4114-95db-28ba77019caf tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] [instance: f9a8b816-21a4-4281-b63e-b0800284a77c] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:20.441367 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a570f3a-eda8-4114-95db-28ba77019caf tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:20.441852 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a570f3a-eda8-4114-95db-28ba77019caf tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:20.442452 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a570f3a-eda8-4114-95db-28ba77019caf tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:20.443153 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a570f3a-eda8-4114-95db-28ba77019caf tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:20.443597 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a570f3a-eda8-4114-95db-28ba77019caf tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:20.444013 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a570f3a-eda8-4114-95db-28ba77019caf tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:20.459862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-0a570f3a-eda8-4114-95db-28ba77019caf tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] HTTP exception thrown: Instance f9a8b816-21a4-4281-b63e-b0800284a77c could not be found. Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0a570f3a-eda8-4114-95db-28ba77019caf tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Request method failure captured: Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c HTTP/1.1 Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0t6KDDIZu8HZQJ0uaVQrwKXoFo0mTznmWZiOpqSbkzyVOUs1DM5fMA5p4l7Mu5JQaz8Cc3FeAMqWWnF1KniAmccRocivexj9la0sQOpyob7mQ5_v9pxqv_0GXrQZeHqWDNkSHivNh_U_23UKcX9R-qqpZ_za64laNATTvPSbVCOnVA Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: 2dbfe7ba453b472ba09b554b59d79281 Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-VolumesActionsTest-121899231 Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:53:20.461538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:53:20.463242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2dbfe7ba453b472ba09b554b59d79281", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2dbfe7ba453b472ba09b554b59d79281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2dbfe7ba453b472ba09b554b59d79281"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2dbfe7ba453b472ba09b554b59d79281"}]}] Aug 31 11:53:20.463242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-VolumesActionsTest-121899231 Aug 31 11:53:20.463242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: 2dbfe7ba453b472ba09b554b59d79281 Aug 31 11:53:20.463242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-VolumesActionsTest-121899231 Aug 31 11:53:20.463242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-VolumesActionsTest-121899231-project Aug 31 11:53:20.463242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:53:20.463242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:53:20.463242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: ea03ffe5a78e4741a47aa8087db14053 Aug 31 11:53:20.463242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-VolumesActionsTest-121899231-project Aug 31 11:53:20.463242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:53:20.463242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance f9a8b816-21a4-4281-b63e-b0800284a77c could not be found. Aug 31 11:53:20.463242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': 'f9a8b816-21a4-4281-b63e-b0800284a77c'} Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9a8b816-21a4-4281-b63e-b0800284a77c could not be found. Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:53:20.464177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9a8b816-21a4-4281-b63e-b0800284a77c could not be found. Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9a8b816-21a4-4281-b63e-b0800284a77c could not be found. Aug 31 11:53:20.467033 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:53:20.468695 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0a570f3a-eda8-4114-95db-28ba77019caf tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] Returning 404 to user: Instance f9a8b816-21a4-4281-b63e-b0800284a77c could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:53:20.468695 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0a570f3a-eda8-4114-95db-28ba77019caf tempest-VolumesActionsTest-121899231 tempest-VolumesActionsTest-121899231-project] 10.222.0.60 "GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c" status: 404 len: 111 microversion: 2.1 time: 0.032829 Aug 31 11:53:20.468695 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 568/1152] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:20 2022] GET /compute/v2.1/servers/f9a8b816-21a4-4281-b63e-b0800284a77c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:53:21.239542 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5e880ba7-702c-4801-93f2-9ab0a9f5eabc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:21.241967 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5e880ba7-702c-4801-93f2-9ab0a9f5eabc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:21.249376 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e880ba7-702c-4801-93f2-9ab0a9f5eabc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:21.249867 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e880ba7-702c-4801-93f2-9ab0a9f5eabc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:21.250299 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e880ba7-702c-4801-93f2-9ab0a9f5eabc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:21.251004 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e880ba7-702c-4801-93f2-9ab0a9f5eabc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:21.251447 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e880ba7-702c-4801-93f2-9ab0a9f5eabc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:21.251869 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5e880ba7-702c-4801-93f2-9ab0a9f5eabc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:21.291415 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5e880ba7-702c-4801-93f2-9ab0a9f5eabc tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055797 Aug 31 11:53:21.291991 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 585/1153] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:53:21 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:53:21.302874 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-71d4a352-7121-4a12-8089-ad6ee702e8a5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:21.303750 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-71d4a352-7121-4a12-8089-ad6ee702e8a5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:21.310061 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71d4a352-7121-4a12-8089-ad6ee702e8a5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:21.310588 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71d4a352-7121-4a12-8089-ad6ee702e8a5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:21.311026 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71d4a352-7121-4a12-8089-ad6ee702e8a5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:21.311723 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71d4a352-7121-4a12-8089-ad6ee702e8a5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:21.312167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71d4a352-7121-4a12-8089-ad6ee702e8a5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:21.312611 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71d4a352-7121-4a12-8089-ad6ee702e8a5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:21.344286 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-71d4a352-7121-4a12-8089-ad6ee702e8a5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments/279af38d-8df2-49c4-8441-817327794b9c" status: 200 len: 194 microversion: 2.1 time: 0.045527 Aug 31 11:53:21.344918 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 569/1154] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Aug 31 11:53:21 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments/279af38d-8df2-49c4-8441-817327794b9c => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:53:26.930106 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c703cd83-3b8d-4589-9e5c-30da99469e26 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "241871bc-2187-47ff-ab4b-5899e60dd360"}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:53:26.932565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c703cd83-3b8d-4589-9e5c-30da99469e26 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:26.941467 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c703cd83-3b8d-4589-9e5c-30da99469e26 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:26.942225 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c703cd83-3b8d-4589-9e5c-30da99469e26 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:26.942859 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c703cd83-3b8d-4589-9e5c-30da99469e26 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:26.943782 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c703cd83-3b8d-4589-9e5c-30da99469e26 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:26.944448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c703cd83-3b8d-4589-9e5c-30da99469e26 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:26.945169 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c703cd83-3b8d-4589-9e5c-30da99469e26 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:27.285790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c703cd83-3b8d-4589-9e5c-30da99469e26 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "POST /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359072 Aug 31 11:53:27.286481 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 586/1155] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 31 11:53:26 2022] POST /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:53:35.013678 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-66bcdc21-13e6-4af4-8bfc-779446ad15a4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:35.016183 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-66bcdc21-13e6-4af4-8bfc-779446ad15a4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:35.019063 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:53:35.019703 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:53:35.026141 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-66bcdc21-13e6-4af4-8bfc-779446ad15a4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:35.026474 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-66bcdc21-13e6-4af4-8bfc-779446ad15a4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:35.026905 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-66bcdc21-13e6-4af4-8bfc-779446ad15a4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:35.028194 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-66bcdc21-13e6-4af4-8bfc-779446ad15a4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:35.028526 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-66bcdc21-13e6-4af4-8bfc-779446ad15a4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:35.028947 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-66bcdc21-13e6-4af4-8bfc-779446ad15a4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:35.070959 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-66bcdc21-13e6-4af4-8bfc-779446ad15a4 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.061284 Aug 31 11:53:35.078368 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 570/1156] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:53:35 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:53:35.227156 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-dc4fdf65-d1f3-4c88-8c5c-537f18be319e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:35.227715 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-dc4fdf65-d1f3-4c88-8c5c-537f18be319e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:35.236384 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dc4fdf65-d1f3-4c88-8c5c-537f18be319e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:35.236760 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dc4fdf65-d1f3-4c88-8c5c-537f18be319e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:35.237194 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dc4fdf65-d1f3-4c88-8c5c-537f18be319e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:35.237912 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dc4fdf65-d1f3-4c88-8c5c-537f18be319e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:35.238362 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dc4fdf65-d1f3-4c88-8c5c-537f18be319e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:35.238789 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-dc4fdf65-d1f3-4c88-8c5c-537f18be319e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:35.273575 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-dc4fdf65-d1f3-4c88-8c5c-537f18be319e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments/279af38d-8df2-49c4-8441-817327794b9c" status: 200 len: 194 microversion: 2.1 time: 0.050974 Aug 31 11:53:35.274403 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 587/1157] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Aug 31 11:53:35 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments/279af38d-8df2-49c4-8441-817327794b9c => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:53:35.286351 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f51bc1aa-903c-45ae-be92-83e0d158d027 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:35.286846 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f51bc1aa-903c-45ae-be92-83e0d158d027 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:35.295773 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f51bc1aa-903c-45ae-be92-83e0d158d027 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:35.295773 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f51bc1aa-903c-45ae-be92-83e0d158d027 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:35.295773 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f51bc1aa-903c-45ae-be92-83e0d158d027 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:35.296381 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f51bc1aa-903c-45ae-be92-83e0d158d027 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:35.296686 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f51bc1aa-903c-45ae-be92-83e0d158d027 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:35.297083 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f51bc1aa-903c-45ae-be92-83e0d158d027 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:35.413827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-f51bc1aa-903c-45ae-be92-83e0d158d027 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lazy-loading 'services' on Instance uuid 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:53:35.516651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f51bc1aa-903c-45ae-be92-83e0d158d027 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments/279af38d-8df2-49c4-8441-817327794b9c" status: 202 len: 0 microversion: 2.1 time: 0.234514 Aug 31 11:53:35.517257 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 571/1158] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 31 11:53:35 2022] DELETE /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments/279af38d-8df2-49c4-8441-817327794b9c => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:53:37.794854 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f3d425fd-8731-4987-98c2-4b8e97ec8eaf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:37.795662 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f3d425fd-8731-4987-98c2-4b8e97ec8eaf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:37.811549 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3d425fd-8731-4987-98c2-4b8e97ec8eaf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:37.812281 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3d425fd-8731-4987-98c2-4b8e97ec8eaf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:37.813057 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3d425fd-8731-4987-98c2-4b8e97ec8eaf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:37.814109 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3d425fd-8731-4987-98c2-4b8e97ec8eaf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:37.814686 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3d425fd-8731-4987-98c2-4b8e97ec8eaf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:37.815216 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3d425fd-8731-4987-98c2-4b8e97ec8eaf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:37.862860 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f3d425fd-8731-4987-98c2-4b8e97ec8eaf tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments/241871bc-2187-47ff-ab4b-5899e60dd360" status: 200 len: 194 microversion: 2.1 time: 0.072468 Aug 31 11:53:37.864137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 588/1159] 10.222.0.60 () {58 vars in 1413 bytes} [Wed Aug 31 11:53:37 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments/241871bc-2187-47ff-ab4b-5899e60dd360 => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:53:37.875778 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-69075324-fef3-4f4c-8fb9-7e90927a1f4e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:37.876387 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-69075324-fef3-4f4c-8fb9-7e90927a1f4e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:37.889661 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-69075324-fef3-4f4c-8fb9-7e90927a1f4e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:37.890752 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-69075324-fef3-4f4c-8fb9-7e90927a1f4e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:37.891339 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-69075324-fef3-4f4c-8fb9-7e90927a1f4e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:37.892241 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-69075324-fef3-4f4c-8fb9-7e90927a1f4e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:37.892896 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-69075324-fef3-4f4c-8fb9-7e90927a1f4e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:37.893479 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-69075324-fef3-4f4c-8fb9-7e90927a1f4e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:38.007304 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-69075324-fef3-4f4c-8fb9-7e90927a1f4e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lazy-loading 'services' on Instance uuid 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:53:38.092066 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-69075324-fef3-4f4c-8fb9-7e90927a1f4e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments/241871bc-2187-47ff-ab4b-5899e60dd360" status: 202 len: 0 microversion: 2.1 time: 0.221303 Aug 31 11:53:38.093091 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 572/1160] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 31 11:53:37 2022] DELETE /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments/241871bc-2187-47ff-ab4b-5899e60dd360 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:53:39.324554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-337fe09e-c9fd-4f37-8bfe-20074c3291b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:39.326907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-337fe09e-c9fd-4f37-8bfe-20074c3291b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:39.334262 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-337fe09e-c9fd-4f37-8bfe-20074c3291b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:39.334761 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-337fe09e-c9fd-4f37-8bfe-20074c3291b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:39.335241 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-337fe09e-c9fd-4f37-8bfe-20074c3291b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:39.335966 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-337fe09e-c9fd-4f37-8bfe-20074c3291b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:39.336422 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-337fe09e-c9fd-4f37-8bfe-20074c3291b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:39.336878 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-337fe09e-c9fd-4f37-8bfe-20074c3291b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:39.356356 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:53:39.374673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-337fe09e-c9fd-4f37-8bfe-20074c3291b2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054130 Aug 31 11:53:39.381253 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 589/1161] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:53:39 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:53:39.529667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d4f5baf3-811d-4e66-8ab2-5c403447cfee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:39.532778 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d4f5baf3-811d-4e66-8ab2-5c403447cfee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:39.541193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d4f5baf3-811d-4e66-8ab2-5c403447cfee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:39.541681 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d4f5baf3-811d-4e66-8ab2-5c403447cfee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:39.542319 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d4f5baf3-811d-4e66-8ab2-5c403447cfee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:39.543634 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d4f5baf3-811d-4e66-8ab2-5c403447cfee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:39.544104 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d4f5baf3-811d-4e66-8ab2-5c403447cfee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:39.544560 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d4f5baf3-811d-4e66-8ab2-5c403447cfee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:39.583070 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d4f5baf3-811d-4e66-8ab2-5c403447cfee tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058790 Aug 31 11:53:39.583666 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 573/1162] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:53:39 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:53:39.682577 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3e983939-9454-4d29-9420-485d0ecf38c9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:39.685077 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3e983939-9454-4d29-9420-485d0ecf38c9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:39.700669 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e983939-9454-4d29-9420-485d0ecf38c9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:39.701986 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e983939-9454-4d29-9420-485d0ecf38c9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:39.704199 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e983939-9454-4d29-9420-485d0ecf38c9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:39.706339 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e983939-9454-4d29-9420-485d0ecf38c9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:39.707943 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e983939-9454-4d29-9420-485d0ecf38c9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:39.710338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e983939-9454-4d29-9420-485d0ecf38c9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:39.773547 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3e983939-9454-4d29-9420-485d0ecf38c9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Going to try to terminate instance {{(pid=127062) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:53:39.905206 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3e983939-9454-4d29-9420-485d0ecf38c9 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 204 len: 0 microversion: 2.1 time: 0.231053 Aug 31 11:53:39.917585 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-39ff5510-cf4d-4a08-bac3-a5634ca39ce7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:39.918698 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-39ff5510-cf4d-4a08-bac3-a5634ca39ce7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:39.921089 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 590/1163] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:53:39 2022] DELETE /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 11:53:39.927380 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39ff5510-cf4d-4a08-bac3-a5634ca39ce7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:39.927935 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39ff5510-cf4d-4a08-bac3-a5634ca39ce7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:39.928784 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39ff5510-cf4d-4a08-bac3-a5634ca39ce7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:39.929685 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39ff5510-cf4d-4a08-bac3-a5634ca39ce7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:39.930222 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39ff5510-cf4d-4a08-bac3-a5634ca39ce7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:39.930670 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-39ff5510-cf4d-4a08-bac3-a5634ca39ce7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:40.149993 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-39ff5510-cf4d-4a08-bac3-a5634ca39ce7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:40.172468 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-39ff5510-cf4d-4a08-bac3-a5634ca39ce7 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1673 microversion: 2.1 time: 0.259531 Aug 31 11:53:40.184518 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 574/1164] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:39 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1673 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:53:41.199664 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a921dd2d-9cda-4813-8212-55cfd9f31f34 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:41.201047 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a921dd2d-9cda-4813-8212-55cfd9f31f34 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:41.211188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a921dd2d-9cda-4813-8212-55cfd9f31f34 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:41.212224 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a921dd2d-9cda-4813-8212-55cfd9f31f34 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:41.213132 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a921dd2d-9cda-4813-8212-55cfd9f31f34 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:41.214221 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a921dd2d-9cda-4813-8212-55cfd9f31f34 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:41.214814 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a921dd2d-9cda-4813-8212-55cfd9f31f34 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:41.215298 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a921dd2d-9cda-4813-8212-55cfd9f31f34 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:41.381979 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a921dd2d-9cda-4813-8212-55cfd9f31f34 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:41.394023 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a921dd2d-9cda-4813-8212-55cfd9f31f34 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1673 microversion: 2.1 time: 0.201964 Aug 31 11:53:41.394781 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 591/1165] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:41 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1673 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:53:42.417010 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c5521eb2-ac1f-4271-85fc-ea9b240c502d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:42.418777 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c5521eb2-ac1f-4271-85fc-ea9b240c502d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:42.425075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c5521eb2-ac1f-4271-85fc-ea9b240c502d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:42.425547 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c5521eb2-ac1f-4271-85fc-ea9b240c502d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:42.425972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c5521eb2-ac1f-4271-85fc-ea9b240c502d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:42.426659 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c5521eb2-ac1f-4271-85fc-ea9b240c502d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:42.427098 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c5521eb2-ac1f-4271-85fc-ea9b240c502d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:42.427509 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c5521eb2-ac1f-4271-85fc-ea9b240c502d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:42.564068 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-c5521eb2-ac1f-4271-85fc-ea9b240c502d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:42.572227 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c5521eb2-ac1f-4271-85fc-ea9b240c502d tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1673 microversion: 2.1 time: 0.159052 Aug 31 11:53:42.572833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 575/1166] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:42 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:53:43.597137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-85ac6890-925f-424a-af05-16a88d9df6af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:43.598680 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-85ac6890-925f-424a-af05-16a88d9df6af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:43.603145 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:53:43.618715 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-85ac6890-925f-424a-af05-16a88d9df6af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:43.621838 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-85ac6890-925f-424a-af05-16a88d9df6af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:43.622473 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-85ac6890-925f-424a-af05-16a88d9df6af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:43.623259 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-85ac6890-925f-424a-af05-16a88d9df6af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:43.623726 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-85ac6890-925f-424a-af05-16a88d9df6af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:43.624161 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-85ac6890-925f-424a-af05-16a88d9df6af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:43.716188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-6831a3cb-f883-4600-bd14-78731892ebe0 req-c32dac42-da97-4030-8ff9-7f3510a1ab3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982", "name": "network-vif-deleted", "tag": "dabf492f-7764-420d-a884-447e69ef70b7"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:53:43.777879 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-6831a3cb-f883-4600-bd14-78731892ebe0 req-c32dac42-da97-4030-8ff9-7f3510a1ab3c service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:43.780346 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-6831a3cb-f883-4600-bd14-78731892ebe0 req-c32dac42-da97-4030-8ff9-7f3510a1ab3c service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:43.781274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-6831a3cb-f883-4600-bd14-78731892ebe0 req-c32dac42-da97-4030-8ff9-7f3510a1ab3c service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:43.811750 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-85ac6890-925f-424a-af05-16a88d9df6af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c4d208994a40fe82310adb18bb3547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacdfff11f2a41f889f7d7cdc41c12dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:53:43.827957 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-85ac6890-925f-424a-af05-16a88d9df6af tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 200 len: 1605 microversion: 2.1 time: 0.237692 Aug 31 11:53:43.829771 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-6831a3cb-f883-4600-bd14-78731892ebe0 req-c32dac42-da97-4030-8ff9-7f3510a1ab3c service nova] Creating event network-vif-deleted:dabf492f-7764-420d-a884-447e69ef70b7 for instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 on hv-cinder-83976 Aug 31 11:53:43.845891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 592/1167] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:43 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 1605 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:53:43.853580 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-6831a3cb-f883-4600-bd14-78731892ebe0 req-c32dac42-da97-4030-8ff9-7f3510a1ab3c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148253 Aug 31 11:53:43.859230 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 576/1168] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:53:44.859239 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-248d16cb-1e3b-4008-a1c6-92d5e01801ef tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:44.861049 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-248d16cb-1e3b-4008-a1c6-92d5e01801ef tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:44.878321 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-248d16cb-1e3b-4008-a1c6-92d5e01801ef tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:44.878823 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-248d16cb-1e3b-4008-a1c6-92d5e01801ef tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:44.879658 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-248d16cb-1e3b-4008-a1c6-92d5e01801ef tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:44.880861 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-248d16cb-1e3b-4008-a1c6-92d5e01801ef tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:44.881386 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-248d16cb-1e3b-4008-a1c6-92d5e01801ef tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:44.886722 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-248d16cb-1e3b-4008-a1c6-92d5e01801ef tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:44.907464 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-248d16cb-1e3b-4008-a1c6-92d5e01801ef tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] HTTP exception thrown: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-248d16cb-1e3b-4008-a1c6-92d5e01801ef tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Request method failure captured: Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 HTTP/1.1 Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lKLIKalYDEcXIg7_ro7nu3mNW1K1GN7nlFNE0wqulh1xelYAuiEYi8z_C_ReFK9K09hMOscHuZY_k9cPFjIP96X5gV1Z5wSUw_2t7d9L86xi-8OPhbW-qeQo0OhwfBFipZtucSzhGlONzO9BvPdLxxuVRdYWc97Fhrm92yXUdEjWk Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: aacdfff11f2a41f889f7d7cdc41c12dc Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:53:44.909905 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:53:44.912969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aacdfff11f2a41f889f7d7cdc41c12dc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aacdfff11f2a41f889f7d7cdc41c12dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aacdfff11f2a41f889f7d7cdc41c12dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aacdfff11f2a41f889f7d7cdc41c12dc"}]}] Aug 31 11:53:44.912969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:53:44.912969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: aacdfff11f2a41f889f7d7cdc41c12dc Aug 31 11:53:44.912969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:53:44.912969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-AttachVolumeTestJSON-410514968-project Aug 31 11:53:44.912969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:53:44.912969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:53:44.912969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 38c4d208994a40fe82310adb18bb3547 Aug 31 11:53:44.912969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-AttachVolumeTestJSON-410514968-project Aug 31 11:53:44.912969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:53:44.912969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. Aug 31 11:53:44.912969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': '3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982'} Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:53:44.914717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. Aug 31 11:53:44.917795 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:44.921879 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-248d16cb-1e3b-4008-a1c6-92d5e01801ef tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Returning 404 to user: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:53:44.921879 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-248d16cb-1e3b-4008-a1c6-92d5e01801ef tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 404 len: 111 microversion: 2.1 time: 0.061978 Aug 31 11:53:44.921879 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 593/1169] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:44 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:53:44.928056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-277b1f41-65d7-433d-a50a-e7aabe6e0cf2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '.version_select at 0x7f1738187040>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:44.964100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-277b1f41-65d7-433d-a50a-e7aabe6e0cf2 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-541095333" status: 202 len: 0 microversion: 2.1 time: 0.041944 Aug 31 11:53:44.966593 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 577/1170] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Aug 31 11:53:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-541095333 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:53:48.127865 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cdb669d5-d2a2-4c32-92bb-92a063e2f767 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:48.129162 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cdb669d5-d2a2-4c32-92bb-92a063e2f767 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:48.143347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdb669d5-d2a2-4c32-92bb-92a063e2f767 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:48.144226 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdb669d5-d2a2-4c32-92bb-92a063e2f767 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:48.145460 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdb669d5-d2a2-4c32-92bb-92a063e2f767 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:48.147041 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdb669d5-d2a2-4c32-92bb-92a063e2f767 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:48.147786 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdb669d5-d2a2-4c32-92bb-92a063e2f767 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:48.148346 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cdb669d5-d2a2-4c32-92bb-92a063e2f767 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:48.166763 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-cdb669d5-d2a2-4c32-92bb-92a063e2f767 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] HTTP exception thrown: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cdb669d5-d2a2-4c32-92bb-92a063e2f767 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Request method failure captured: Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: DELETE /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 HTTP/1.1 Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lKLIKalYDEcXIg7_ro7nu3mNW1K1GN7nlFNE0wqulh1xelYAuiEYi8z_C_ReFK9K09hMOscHuZY_k9cPFjIP96X5gV1Z5wSUw_2t7d9L86xi-8OPhbW-qeQo0OhwfBFipZtucSzhGlONzO9BvPdLxxuVRdYWc97Fhrm92yXUdEjWk Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: aacdfff11f2a41f889f7d7cdc41c12dc Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:53:48.169699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:53:48.171448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aacdfff11f2a41f889f7d7cdc41c12dc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aacdfff11f2a41f889f7d7cdc41c12dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aacdfff11f2a41f889f7d7cdc41c12dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aacdfff11f2a41f889f7d7cdc41c12dc"}]}] Aug 31 11:53:48.171448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:53:48.171448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: aacdfff11f2a41f889f7d7cdc41c12dc Aug 31 11:53:48.171448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:53:48.171448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-AttachVolumeTestJSON-410514968-project Aug 31 11:53:48.171448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:53:48.171448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:53:48.171448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 38c4d208994a40fe82310adb18bb3547 Aug 31 11:53:48.171448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-AttachVolumeTestJSON-410514968-project Aug 31 11:53:48.171448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:53:48.171448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. Aug 31 11:53:48.171448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': '3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982'} Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:53:48.172360 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. Aug 31 11:53:48.173984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:48.175892 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cdb669d5-d2a2-4c32-92bb-92a063e2f767 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Returning 404 to user: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:53:48.175892 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cdb669d5-d2a2-4c32-92bb-92a063e2f767 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 404 len: 111 microversion: 2.1 time: 0.049772 Aug 31 11:53:48.175892 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 594/1171] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:53:48 2022] DELETE /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:53:48.181495 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fea40026-add5-41df-b221-1fdc4bede4ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:48.182428 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fea40026-add5-41df-b221-1fdc4bede4ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:48.190504 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fea40026-add5-41df-b221-1fdc4bede4ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:48.190912 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fea40026-add5-41df-b221-1fdc4bede4ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:48.191346 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fea40026-add5-41df-b221-1fdc4bede4ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:48.192048 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fea40026-add5-41df-b221-1fdc4bede4ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:48.192521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fea40026-add5-41df-b221-1fdc4bede4ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:48.192941 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fea40026-add5-41df-b221-1fdc4bede4ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:48.207486 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-fea40026-add5-41df-b221-1fdc4bede4ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] HTTP exception thrown: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fea40026-add5-41df-b221-1fdc4bede4ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Request method failure captured: Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 HTTP/1.1 Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lKLIKalYDEcXIg7_ro7nu3mNW1K1GN7nlFNE0wqulh1xelYAuiEYi8z_C_ReFK9K09hMOscHuZY_k9cPFjIP96X5gV1Z5wSUw_2t7d9L86xi-8OPhbW-qeQo0OhwfBFipZtucSzhGlONzO9BvPdLxxuVRdYWc97Fhrm92yXUdEjWk Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: aacdfff11f2a41f889f7d7cdc41c12dc Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:53:48.209167 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:53:48.210744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aacdfff11f2a41f889f7d7cdc41c12dc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aacdfff11f2a41f889f7d7cdc41c12dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aacdfff11f2a41f889f7d7cdc41c12dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aacdfff11f2a41f889f7d7cdc41c12dc"}]}] Aug 31 11:53:48.210744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:53:48.210744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: aacdfff11f2a41f889f7d7cdc41c12dc Aug 31 11:53:48.210744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:53:48.210744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-AttachVolumeTestJSON-410514968-project Aug 31 11:53:48.210744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:53:48.210744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:53:48.210744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 38c4d208994a40fe82310adb18bb3547 Aug 31 11:53:48.210744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-AttachVolumeTestJSON-410514968-project Aug 31 11:53:48.210744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:53:48.210744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. Aug 31 11:53:48.210744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982'} Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:53:48.211651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. Aug 31 11:53:48.213136 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:53:48.215636 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fea40026-add5-41df-b221-1fdc4bede4ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Returning 404 to user: Instance 3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:53:48.216476 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-fea40026-add5-41df-b221-1fdc4bede4ab tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982" status: 404 len: 111 microversion: 2.1 time: 0.040302 Aug 31 11:53:48.217066 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 578/1172] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:48 2022] GET /compute/v2.1/servers/3f3dd4a4-9d72-4fde-9dc8-08dd65f7c982 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:53:49.378029 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4c5b8edd-0d92-485f-8fa2-e391d6e4093e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:49.378599 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4c5b8edd-0d92-485f-8fa2-e391d6e4093e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:49.388344 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4c5b8edd-0d92-485f-8fa2-e391d6e4093e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:49.389321 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4c5b8edd-0d92-485f-8fa2-e391d6e4093e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:49.390262 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4c5b8edd-0d92-485f-8fa2-e391d6e4093e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:49.391887 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4c5b8edd-0d92-485f-8fa2-e391d6e4093e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:49.392688 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4c5b8edd-0d92-485f-8fa2-e391d6e4093e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:49.393356 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4c5b8edd-0d92-485f-8fa2-e391d6e4093e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:49.427530 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-4c5b8edd-0d92-485f-8fa2-e391d6e4093e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] HTTP exception thrown: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4c5b8edd-0d92-485f-8fa2-e391d6e4093e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Request method failure captured: Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: DELETE /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 HTTP/1.1 Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lKLIKalYDEcXIg7_ro7nu3mNW1K1GN7nlFNE0wqulh1xelYAuiEYi8z_C_ReFK9K09hMOscHuZY_k9cPFjIP96X5gV1Z5wSUw_2t7d9L86xi-8OPhbW-qeQo0OhwfBFipZtucSzhGlONzO9BvPdLxxuVRdYWc97Fhrm92yXUdEjWk Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: aacdfff11f2a41f889f7d7cdc41c12dc Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:53:49.429569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:53:49.431230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aacdfff11f2a41f889f7d7cdc41c12dc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aacdfff11f2a41f889f7d7cdc41c12dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aacdfff11f2a41f889f7d7cdc41c12dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aacdfff11f2a41f889f7d7cdc41c12dc"}]}] Aug 31 11:53:49.431230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:53:49.431230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: aacdfff11f2a41f889f7d7cdc41c12dc Aug 31 11:53:49.431230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:53:49.431230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-AttachVolumeTestJSON-410514968-project Aug 31 11:53:49.431230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:53:49.431230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:53:49.431230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 38c4d208994a40fe82310adb18bb3547 Aug 31 11:53:49.431230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-AttachVolumeTestJSON-410514968-project Aug 31 11:53:49.431230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:53:49.431230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. Aug 31 11:53:49.431230 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': 'c0cfd5ee-9585-4f45-b34a-b0e87ae35723'} Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:53:49.432072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. Aug 31 11:53:49.438174 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:49.439606 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4c5b8edd-0d92-485f-8fa2-e391d6e4093e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Returning 404 to user: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:53:49.439606 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4c5b8edd-0d92-485f-8fa2-e391d6e4093e tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 404 len: 111 microversion: 2.1 time: 0.058036 Aug 31 11:53:49.439606 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 595/1173] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:53:49 2022] DELETE /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:53:49.444831 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f55eb5cd-f65d-4cc3-b824-08d75b9f19f5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:49.445425 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f55eb5cd-f65d-4cc3-b824-08d75b9f19f5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] [instance: c0cfd5ee-9585-4f45-b34a-b0e87ae35723] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:53:49.454382 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f55eb5cd-f65d-4cc3-b824-08d75b9f19f5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:49.456027 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f55eb5cd-f65d-4cc3-b824-08d75b9f19f5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:49.456616 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f55eb5cd-f65d-4cc3-b824-08d75b9f19f5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:49.458056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f55eb5cd-f65d-4cc3-b824-08d75b9f19f5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:53:49.459871 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f55eb5cd-f65d-4cc3-b824-08d75b9f19f5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:53:49.461168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f55eb5cd-f65d-4cc3-b824-08d75b9f19f5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:53:49.506511 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-f55eb5cd-f65d-4cc3-b824-08d75b9f19f5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] HTTP exception thrown: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f55eb5cd-f65d-4cc3-b824-08d75b9f19f5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Request method failure captured: Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 HTTP/1.1 Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lKLIKalYDEcXIg7_ro7nu3mNW1K1GN7nlFNE0wqulh1xelYAuiEYi8z_C_ReFK9K09hMOscHuZY_k9cPFjIP96X5gV1Z5wSUw_2t7d9L86xi-8OPhbW-qeQo0OhwfBFipZtucSzhGlONzO9BvPdLxxuVRdYWc97Fhrm92yXUdEjWk Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: aacdfff11f2a41f889f7d7cdc41c12dc Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:53:49.507833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:53:49.509654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aacdfff11f2a41f889f7d7cdc41c12dc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aacdfff11f2a41f889f7d7cdc41c12dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aacdfff11f2a41f889f7d7cdc41c12dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aacdfff11f2a41f889f7d7cdc41c12dc"}]}] Aug 31 11:53:49.509654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:53:49.509654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: aacdfff11f2a41f889f7d7cdc41c12dc Aug 31 11:53:49.509654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-AttachVolumeTestJSON-410514968 Aug 31 11:53:49.509654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-AttachVolumeTestJSON-410514968-project Aug 31 11:53:49.509654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:53:49.509654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:53:49.509654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 38c4d208994a40fe82310adb18bb3547 Aug 31 11:53:49.509654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-AttachVolumeTestJSON-410514968-project Aug 31 11:53:49.509654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:53:49.509654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. Aug 31 11:53:49.509654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': 'c0cfd5ee-9585-4f45-b34a-b0e87ae35723'} Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:53:49.510729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. Aug 31 11:53:49.512680 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:53:49.513951 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f55eb5cd-f65d-4cc3-b824-08d75b9f19f5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] Returning 404 to user: Instance c0cfd5ee-9585-4f45-b34a-b0e87ae35723 could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:53:49.513951 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f55eb5cd-f65d-4cc3-b824-08d75b9f19f5 tempest-AttachVolumeTestJSON-410514968 tempest-AttachVolumeTestJSON-410514968-project] 10.222.0.60 "GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723" status: 404 len: 111 microversion: 2.1 time: 0.070274 Aug 31 11:53:49.513951 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 579/1174] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:53:49 2022] GET /compute/v2.1/servers/c0cfd5ee-9585-4f45-b34a-b0e87ae35723 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:53:56.786835 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-fd45d292-66db-4101-9f0f-516cd8e4e88d tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] Action: 'create', calling method: .version_select at 0x7f173472a940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-194156246", "metadata": {"Type": "work"}}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:53:57.461028 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-fd45d292-66db-4101-9f0f-516cd8e4e88d tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.864933 Aug 31 11:53:57.461659 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 596/1175] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Aug 31 11:53:56 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 866 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 11:53:57.476055 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d6875a0d-566a-4587-91e7-790b52a1b0df tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] Calling method '.version_select at 0x7f1734ad40d0>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:57.581342 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d6875a0d-566a-4587-91e7-790b52a1b0df tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0182063f-646e-45ea-92ef-a3b548312411" status: 200 len: 352 microversion: 2.1 time: 0.110225 Aug 31 11:53:57.582299 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 580/1176] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:53:57 2022] GET /compute/v2.1/os-volumes/0182063f-646e-45ea-92ef-a3b548312411 => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:53:58.597666 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-47c17eda-9e10-4538-9118-9248b0d381de tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] Calling method '.version_select at 0x7f17349df700>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:58.657859 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-47c17eda-9e10-4538-9118-9248b0d381de tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0182063f-646e-45ea-92ef-a3b548312411" status: 200 len: 353 microversion: 2.1 time: 0.064972 Aug 31 11:53:58.658705 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 597/1177] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:53:58 2022] GET /compute/v2.1/os-volumes/0182063f-646e-45ea-92ef-a3b548312411 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:53:58.673515 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-91091d3d-11db-4e98-a927-fcdeba0b067c tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] Calling method '.version_select at 0x7f1738187940>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:58.733137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-91091d3d-11db-4e98-a927-fcdeba0b067c tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0182063f-646e-45ea-92ef-a3b548312411" status: 200 len: 353 microversion: 2.1 time: 0.065051 Aug 31 11:53:58.734344 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 581/1178] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:53:58 2022] GET /compute/v2.1/os-volumes/0182063f-646e-45ea-92ef-a3b548312411 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:53:58.753816 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3d02b7d1-e00a-436a-9930-bb794aa285e7 tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] Calling method '.version_select at 0x7f1734bf7280>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:58.846561 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3d02b7d1-e00a-436a-9930-bb794aa285e7 tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/0182063f-646e-45ea-92ef-a3b548312411" status: 202 len: 0 microversion: 2.1 time: 0.096497 Aug 31 11:53:58.850593 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 598/1179] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 31 11:53:58 2022] DELETE /compute/v2.1/os-volumes/0182063f-646e-45ea-92ef-a3b548312411 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:53:58.857359 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c5080bec-9856-48ae-a979-39c8201f8974 tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] Calling method '.version_select at 0x7f17349df280>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:58.913769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c5080bec-9856-48ae-a979-39c8201f8974 tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0182063f-646e-45ea-92ef-a3b548312411" status: 200 len: 352 microversion: 2.1 time: 0.061205 Aug 31 11:53:58.914724 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 599/1180] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:53:58 2022] GET /compute/v2.1/os-volumes/0182063f-646e-45ea-92ef-a3b548312411 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:53:58.960281 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-979f7f62-e09b-43da-b627-60141074c0a1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Action: 'create', calling method: .version_select at 0x7f1738289ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1087282435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0u7llfU+4Xly0K7Pao2vuiMj2KiI1WjZkn8THKja7Nr2g0+t7/+aaUuCxSaYd8F3zzwbE1XoSwdf6bpvrYE5rXkRk7EGtHvREUpm5VuQdcZD2wN3aWQ9fuji3kr+VkCA=="}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:53:58.977629 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-979f7f62-e09b-43da-b627-60141074c0a1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Getting quotas for project 2cfb480658dd40f1a1f0fd5c627e843c. Resources: {'key_pairs'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:53:58.983021 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-979f7f62-e09b-43da-b627-60141074c0a1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Getting quotas for user b5cf28697ff04a3ebd70b780c10dd830 and project 2cfb480658dd40f1a1f0fd5c627e843c. Resources: {'key_pairs'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:53:59.007303 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-979f7f62-e09b-43da-b627-60141074c0a1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.192364 Aug 31 11:53:59.008094 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 582/1181] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 31 11:53:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:53:59.925102 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=7 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:53:59.925979 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:53:59.933364 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1d4bd281-40a6-4b24-a3e6-ed611dcb45e2 tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] Calling method '.version_select at 0x7f1734da8040>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:53:59.982779 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-1d4bd281-40a6-4b24-a3e6-ed611dcb45e2 tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] HTTP exception thrown: Volume 0182063f-646e-45ea-92ef-a3b548312411 could not be found. Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1d4bd281-40a6-4b24-a3e6-ed611dcb45e2 tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] Request method failure captured: Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/os-volumes/0182063f-646e-45ea-92ef-a3b548312411 HTTP/1.1 Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0vUHiVpV7DVQ_GtFrnHSj8grSRm0FKcAg2TTpVlE3ALJ_4_wlTS2zMXTehWnxSA0I-SPse1SQ1muTLGkmKi82VCD8LaU9kRjXt0rOoewJ2SMM6atItzuUbCLX3obg8XgD2jJe6Y45bR6gZOGCED52Kmzl-AqukU81qwmgL5cdIthYw Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 258a5512809f4fd29ff55b6c4a570cbc Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-VolumesGetTestJSON-1245997422 Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:53:59.987142 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:53:59.988818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_258a5512809f4fd29ff55b6c4a570cbc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/258a5512809f4fd29ff55b6c4a570cbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258a5512809f4fd29ff55b6c4a570cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/258a5512809f4fd29ff55b6c4a570cbc"}]}] Aug 31 11:53:59.988818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-VolumesGetTestJSON-1245997422 Aug 31 11:53:59.988818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 258a5512809f4fd29ff55b6c4a570cbc Aug 31 11:53:59.988818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-VolumesGetTestJSON-1245997422 Aug 31 11:53:59.988818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-VolumesGetTestJSON-1245997422-project Aug 31 11:53:59.988818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:53:59.988818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:53:59.988818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 85e3a6000e9341fdb8062cde59693480 Aug 31 11:53:59.988818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-VolumesGetTestJSON-1245997422-project Aug 31 11:53:59.988818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: Aug 31 11:53:59.988818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Volume 0182063f-646e-45ea-92ef-a3b548312411 could not be found. Aug 31 11:53:59.988818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': '0182063f-646e-45ea-92ef-a3b548312411'} Aug 31 11:53:59.988818 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0182063f-646e-45ea-92ef-a3b548312411 could not be found. (HTTP 404) (Request-ID: req-619e1d81-5ac2-4478-ae85-130004b17c89) Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:53:59.993146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:53:59.995476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0182063f-646e-45ea-92ef-a3b548312411 could not be found. Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 11:53:59.997358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:53:59.998692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0182063f-646e-45ea-92ef-a3b548312411 could not be found. Aug 31 11:53:59.998692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:59.998692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:53:59.998692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:59.998692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:53:59.998692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:53:59.998692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:53:59.998692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:53:59.998692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:53:59.998692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0182063f-646e-45ea-92ef-a3b548312411 could not be found. Aug 31 11:53:59.998692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:53:59.998692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1d4bd281-40a6-4b24-a3e6-ed611dcb45e2 tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] Returning 404 to user: Volume 0182063f-646e-45ea-92ef-a3b548312411 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:53:59.998692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1d4bd281-40a6-4b24-a3e6-ed611dcb45e2 tempest-VolumesGetTestJSON-1245997422 tempest-VolumesGetTestJSON-1245997422-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0182063f-646e-45ea-92ef-a3b548312411" status: 404 len: 109 microversion: 2.1 time: 0.064499 Aug 31 11:53:59.998692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 600/1182] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:53:59 2022] GET /compute/v2.1/os-volumes/0182063f-646e-45ea-92ef-a3b548312411 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:54:16.631078 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:54:16.632602 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=4 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:54:16.633281 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:54:16.637751 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a9676afd-342d-413e-a43c-7376d2cb03a4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:16.638245 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a9676afd-342d-413e-a43c-7376d2cb03a4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:16.646751 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a9676afd-342d-413e-a43c-7376d2cb03a4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:16.647233 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a9676afd-342d-413e-a43c-7376d2cb03a4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:16.647667 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a9676afd-342d-413e-a43c-7376d2cb03a4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:16.648355 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a9676afd-342d-413e-a43c-7376d2cb03a4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:16.648847 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a9676afd-342d-413e-a43c-7376d2cb03a4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:16.649272 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a9676afd-342d-413e-a43c-7376d2cb03a4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:16.674120 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a9676afd-342d-413e-a43c-7376d2cb03a4 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18/ips" status: 200 len: 149 microversion: 2.1 time: 0.043838 Aug 31 11:54:16.674707 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 583/1183] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 31 11:54:16 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:20.133452 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-73da4131-25a2-4067-bbf5-0230940ac146 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "728723e8-ac80-4b9d-97fc-f03e0844aa20"}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:54:20.136017 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-73da4131-25a2-4067-bbf5-0230940ac146 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:20.142095 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-73da4131-25a2-4067-bbf5-0230940ac146 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:20.142571 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-73da4131-25a2-4067-bbf5-0230940ac146 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:20.142998 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-73da4131-25a2-4067-bbf5-0230940ac146 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:20.143683 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-73da4131-25a2-4067-bbf5-0230940ac146 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:20.144126 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-73da4131-25a2-4067-bbf5-0230940ac146 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:20.144568 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-73da4131-25a2-4067-bbf5-0230940ac146 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:20.394425 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-73da4131-25a2-4067-bbf5-0230940ac146 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "POST /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266189 Aug 31 11:54:20.395027 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 601/1184] 10.222.0.60 () {60 vars in 1323 bytes} [Wed Aug 31 11:54:20 2022] POST /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:22.955529 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1804259944", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1087282435", "security_groups": [{"name": "tempest-secgroup-smoke-1524087799"}], "networks": [{"uuid": "ba95a115-cc99-4c9d-a27b-3971978c3365"}], "block_device_mapping_v2": [{"uuid": "b670cded-63c5-46e2-b7a5-9d23bdf2d9cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:54:23.081189 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.network.neutron [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] validate_networks() for [('ba95a115-cc99-4c9d-a27b-3971978c3365', None, None, None, None, None)] {{(pid=127061) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:54:23.484350 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Flavor limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:54:23.484803 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Image limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:54:23.485277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Flavor pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:54:23.485687 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Image pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:54:23.486095 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:54:23.495413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:23.495892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:23.496327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:23.497077 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:23.497530 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:23.497952 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:23.515501 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Getting quotas for project 2cfb480658dd40f1a1f0fd5c627e843c. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:54:23.519518 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Getting quotas for user b5cf28697ff04a3ebd70b780c10dd830 and project 2cfb480658dd40f1a1f0fd5c627e843c. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:54:23.582822 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Going to run 1 instances... {{(pid=127061) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:54:23.585569 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b670cded-63c5-46e2-b7a5-9d23bdf2d9cd',volume_size=None,volume_type=None)] {{(pid=127061) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:54:23.744338 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-149e3229-f4e8-4054-a521-7d68e0c7492c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.792297 Aug 31 11:54:23.745773 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 584/1185] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:54:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:54:23.757077 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-1daa0708-25b6-47c3-b7bb-3cce074e5ef3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:23.758157 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-1daa0708-25b6-47c3-b7bb-3cce074e5ef3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:23.825479 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-1daa0708-25b6-47c3-b7bb-3cce074e5ef3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:23.832631 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-1daa0708-25b6-47c3-b7bb-3cce074e5ef3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1089 microversion: 2.1 time: 0.080441 Aug 31 11:54:23.833339 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 602/1186] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:23 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1089 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:24.855329 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b1a9cfb3-a478-47aa-bd98-81fcdf7a39d1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:24.855746 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b1a9cfb3-a478-47aa-bd98-81fcdf7a39d1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:24.862213 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b1a9cfb3-a478-47aa-bd98-81fcdf7a39d1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:24.862696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b1a9cfb3-a478-47aa-bd98-81fcdf7a39d1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:24.863170 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b1a9cfb3-a478-47aa-bd98-81fcdf7a39d1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:24.864060 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b1a9cfb3-a478-47aa-bd98-81fcdf7a39d1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:24.864600 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b1a9cfb3-a478-47aa-bd98-81fcdf7a39d1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:24.865013 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b1a9cfb3-a478-47aa-bd98-81fcdf7a39d1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:24.941137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b1a9cfb3-a478-47aa-bd98-81fcdf7a39d1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:24.950760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b1a9cfb3-a478-47aa-bd98-81fcdf7a39d1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1195 microversion: 2.1 time: 0.101014 Aug 31 11:54:24.951471 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 585/1187] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:24 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1195 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:25.973146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6da68262-5f0f-4a6e-9d4d-6c9bed5be315 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:25.974344 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6da68262-5f0f-4a6e-9d4d-6c9bed5be315 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:25.984056 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6da68262-5f0f-4a6e-9d4d-6c9bed5be315 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:25.984570 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6da68262-5f0f-4a6e-9d4d-6c9bed5be315 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:25.985004 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6da68262-5f0f-4a6e-9d4d-6c9bed5be315 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:25.985874 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6da68262-5f0f-4a6e-9d4d-6c9bed5be315 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:25.986350 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6da68262-5f0f-4a6e-9d4d-6c9bed5be315 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:25.986814 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6da68262-5f0f-4a6e-9d4d-6c9bed5be315 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:26.199769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-6da68262-5f0f-4a6e-9d4d-6c9bed5be315 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:26.209108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6da68262-5f0f-4a6e-9d4d-6c9bed5be315 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1273 microversion: 2.1 time: 0.240262 Aug 31 11:54:26.209768 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 603/1188] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:25 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:26.596625 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-313c6801-9331-4fb4-b338-b80685a59b46 req-c7c88861-c736-44ee-97de-a7eadaff0180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae99bf4-5a13-4a75-9b1d-74322674eef7", "tag": "ae42fa42-e307-48c8-84d2-bb9169f0531f"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:54:26.607206 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-313c6801-9331-4fb4-b338-b80685a59b46 req-c7c88861-c736-44ee-97de-a7eadaff0180 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:26.607964 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-313c6801-9331-4fb4-b338-b80685a59b46 req-c7c88861-c736-44ee-97de-a7eadaff0180 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:26.608600 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-313c6801-9331-4fb4-b338-b80685a59b46 req-c7c88861-c736-44ee-97de-a7eadaff0180 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:26.622165 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-313c6801-9331-4fb4-b338-b80685a59b46 req-c7c88861-c736-44ee-97de-a7eadaff0180 service nova] Creating event network-changed:ae42fa42-e307-48c8-84d2-bb9169f0531f for instance cae99bf4-5a13-4a75-9b1d-74322674eef7 on hv-cinder-83976 Aug 31 11:54:26.628507 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-313c6801-9331-4fb4-b338-b80685a59b46 req-c7c88861-c736-44ee-97de-a7eadaff0180 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191326 Aug 31 11:54:26.629109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 586/1189] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:26.932481 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8f55a66e-c313-477b-b3f4-186d3aa98cb7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:26.935581 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8f55a66e-c313-477b-b3f4-186d3aa98cb7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:26.948521 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8f55a66e-c313-477b-b3f4-186d3aa98cb7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:26.949004 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8f55a66e-c313-477b-b3f4-186d3aa98cb7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:26.949431 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8f55a66e-c313-477b-b3f4-186d3aa98cb7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:26.950123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8f55a66e-c313-477b-b3f4-186d3aa98cb7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:26.957026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8f55a66e-c313-477b-b3f4-186d3aa98cb7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:26.957518 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8f55a66e-c313-477b-b3f4-186d3aa98cb7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:27.006800 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8f55a66e-c313-477b-b3f4-186d3aa98cb7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.080352 Aug 31 11:54:27.007936 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 604/1190] 10.222.0.60 () {60 vars in 1343 bytes} [Wed Aug 31 11:54:26 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:27.116850 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e85eb8f2-db64-4096-bc49-ff7fbbe3e2c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:27.117444 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e85eb8f2-db64-4096-bc49-ff7fbbe3e2c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:27.138149 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e85eb8f2-db64-4096-bc49-ff7fbbe3e2c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:27.138668 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e85eb8f2-db64-4096-bc49-ff7fbbe3e2c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:27.139158 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e85eb8f2-db64-4096-bc49-ff7fbbe3e2c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:27.139830 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e85eb8f2-db64-4096-bc49-ff7fbbe3e2c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:27.140356 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e85eb8f2-db64-4096-bc49-ff7fbbe3e2c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:27.140835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e85eb8f2-db64-4096-bc49-ff7fbbe3e2c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:27.170840 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e85eb8f2-db64-4096-bc49-ff7fbbe3e2c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Going to try to terminate instance {{(pid=127061) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:54:27.232221 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-04b53ee7-c8e3-45f5-ac0d-4f1da11e305f tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:27.232848 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-04b53ee7-c8e3-45f5-ac0d-4f1da11e305f tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:27.239318 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-04b53ee7-c8e3-45f5-ac0d-4f1da11e305f tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:27.239799 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-04b53ee7-c8e3-45f5-ac0d-4f1da11e305f tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:27.240224 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-04b53ee7-c8e3-45f5-ac0d-4f1da11e305f tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:27.241126 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-04b53ee7-c8e3-45f5-ac0d-4f1da11e305f tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:27.241622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-04b53ee7-c8e3-45f5-ac0d-4f1da11e305f tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:27.242316 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-04b53ee7-c8e3-45f5-ac0d-4f1da11e305f tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:27.258022 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e85eb8f2-db64-4096-bc49-ff7fbbe3e2c1 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "DELETE /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 204 len: 0 microversion: 2.20 time: 0.155390 Aug 31 11:54:27.258808 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 587/1191] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Aug 31 11:54:27 2022] DELETE /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 11:54:27.268092 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-eaeef7cd-0bbb-4ed9-ac9a-82d3d35014d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:27.268824 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-eaeef7cd-0bbb-4ed9-ac9a-82d3d35014d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:27.275361 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eaeef7cd-0bbb-4ed9-ac9a-82d3d35014d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:27.275997 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eaeef7cd-0bbb-4ed9-ac9a-82d3d35014d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:27.276434 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eaeef7cd-0bbb-4ed9-ac9a-82d3d35014d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:27.277175 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eaeef7cd-0bbb-4ed9-ac9a-82d3d35014d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:27.277626 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eaeef7cd-0bbb-4ed9-ac9a-82d3d35014d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:27.278053 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-eaeef7cd-0bbb-4ed9-ac9a-82d3d35014d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:27.414420 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-eaeef7cd-0bbb-4ed9-ac9a-82d3d35014d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:27.423597 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-eaeef7cd-0bbb-4ed9-ac9a-82d3d35014d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:27.425059 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-eaeef7cd-0bbb-4ed9-ac9a-82d3d35014d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:27.426211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-eaeef7cd-0bbb-4ed9-ac9a-82d3d35014d5 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.162478 Aug 31 11:54:27.426762 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 588/1192] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:54:27 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:54:27.437035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-04b53ee7-c8e3-45f5-ac0d-4f1da11e305f tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:27.445110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-04b53ee7-c8e3-45f5-ac0d-4f1da11e305f tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1273 microversion: 2.1 time: 0.216920 Aug 31 11:54:27.445666 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 605/1193] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:27 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1273 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:54:28.083571 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c9919ae6-536f-4635-8757-42fe727a5b92 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:28.084122 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-c9919ae6-536f-4635-8757-42fe727a5b92 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:28.091453 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c9919ae6-536f-4635-8757-42fe727a5b92 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:28.091939 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c9919ae6-536f-4635-8757-42fe727a5b92 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:28.092391 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c9919ae6-536f-4635-8757-42fe727a5b92 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:28.093121 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c9919ae6-536f-4635-8757-42fe727a5b92 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:28.093573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c9919ae6-536f-4635-8757-42fe727a5b92 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:28.093998 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-c9919ae6-536f-4635-8757-42fe727a5b92 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:28.180070 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-c9919ae6-536f-4635-8757-42fe727a5b92 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lazy-loading 'services' on Instance uuid 052cfef0-621e-4a5e-bb48-b0bd7b753e18 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:54:28.261712 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c9919ae6-536f-4635-8757-42fe727a5b92 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "DELETE /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18/os-volume_attachments/728723e8-ac80-4b9d-97fc-f03e0844aa20" status: 202 len: 0 microversion: 2.1 time: 0.181789 Aug 31 11:54:28.262733 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 589/1194] 10.222.0.60 () {58 vars in 1416 bytes} [Wed Aug 31 11:54:28 2022] DELETE /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18/os-volume_attachments/728723e8-ac80-4b9d-97fc-f03e0844aa20 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:54:28.272656 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-22e2cde7-1e66-45b6-8c8a-0ab17264503f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:28.275290 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-22e2cde7-1e66-45b6-8c8a-0ab17264503f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:28.282327 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22e2cde7-1e66-45b6-8c8a-0ab17264503f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:28.283126 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22e2cde7-1e66-45b6-8c8a-0ab17264503f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:28.283666 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22e2cde7-1e66-45b6-8c8a-0ab17264503f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:28.284383 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22e2cde7-1e66-45b6-8c8a-0ab17264503f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:28.284902 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22e2cde7-1e66-45b6-8c8a-0ab17264503f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:28.285376 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-22e2cde7-1e66-45b6-8c8a-0ab17264503f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:28.340937 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-22e2cde7-1e66-45b6-8c8a-0ab17264503f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072445 Aug 31 11:54:28.341707 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 606/1195] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:54:28 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:28.452052 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b5e6e0de-2dbd-4f1d-a74c-6eed9b394e3c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:28.452738 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b5e6e0de-2dbd-4f1d-a74c-6eed9b394e3c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:28.463808 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b5e6e0de-2dbd-4f1d-a74c-6eed9b394e3c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:28.464747 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b5e6e0de-2dbd-4f1d-a74c-6eed9b394e3c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:28.465349 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b5e6e0de-2dbd-4f1d-a74c-6eed9b394e3c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:28.466427 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b5e6e0de-2dbd-4f1d-a74c-6eed9b394e3c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:28.467038 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b5e6e0de-2dbd-4f1d-a74c-6eed9b394e3c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:28.467637 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b5e6e0de-2dbd-4f1d-a74c-6eed9b394e3c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:28.468335 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9558073e-92b0-49a4-8af9-eb3d5b9dd8fb tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:28.469004 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9558073e-92b0-49a4-8af9-eb3d5b9dd8fb tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:28.475992 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9558073e-92b0-49a4-8af9-eb3d5b9dd8fb tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:28.476515 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9558073e-92b0-49a4-8af9-eb3d5b9dd8fb tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:28.477519 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9558073e-92b0-49a4-8af9-eb3d5b9dd8fb tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:28.478323 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9558073e-92b0-49a4-8af9-eb3d5b9dd8fb tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:28.478803 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9558073e-92b0-49a4-8af9-eb3d5b9dd8fb tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:28.479317 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9558073e-92b0-49a4-8af9-eb3d5b9dd8fb tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:28.628162 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b5e6e0de-2dbd-4f1d-a74c-6eed9b394e3c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:28.636854 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b5e6e0de-2dbd-4f1d-a74c-6eed9b394e3c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:28.638285 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-b5e6e0de-2dbd-4f1d-a74c-6eed9b394e3c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:28.639455 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b5e6e0de-2dbd-4f1d-a74c-6eed9b394e3c tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.192211 Aug 31 11:54:28.640003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 590/1196] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:54:28 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:54:28.764770 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-9558073e-92b0-49a4-8af9-eb3d5b9dd8fb tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:28.773513 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9558073e-92b0-49a4-8af9-eb3d5b9dd8fb tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1273 microversion: 2.1 time: 0.310133 Aug 31 11:54:28.774316 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 607/1197] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:28 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1273 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:29.353156 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-b48c1bac-f5e0-4a65-ae18-9f5e126fa498 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:29.355386 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-b48c1bac-f5e0-4a65-ae18-9f5e126fa498 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:29.362370 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b48c1bac-f5e0-4a65-ae18-9f5e126fa498 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:29.362933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b48c1bac-f5e0-4a65-ae18-9f5e126fa498 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:29.363414 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b48c1bac-f5e0-4a65-ae18-9f5e126fa498 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:29.364186 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b48c1bac-f5e0-4a65-ae18-9f5e126fa498 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:29.364659 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b48c1bac-f5e0-4a65-ae18-9f5e126fa498 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:29.365074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-b48c1bac-f5e0-4a65-ae18-9f5e126fa498 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:29.396125 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-b48c1bac-f5e0-4a65-ae18-9f5e126fa498 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046834 Aug 31 11:54:29.396746 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 591/1198] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:54:29 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:29.663880 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-af7ec4f9-affa-4439-a9dd-b14fbd4dcdf7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:29.664510 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-af7ec4f9-affa-4439-a9dd-b14fbd4dcdf7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:29.670781 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-af7ec4f9-affa-4439-a9dd-b14fbd4dcdf7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:29.671253 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-af7ec4f9-affa-4439-a9dd-b14fbd4dcdf7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:29.671682 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-af7ec4f9-affa-4439-a9dd-b14fbd4dcdf7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:29.672372 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-af7ec4f9-affa-4439-a9dd-b14fbd4dcdf7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:29.672838 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-af7ec4f9-affa-4439-a9dd-b14fbd4dcdf7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:29.673257 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-af7ec4f9-affa-4439-a9dd-b14fbd4dcdf7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:29.804176 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-26e60e03-ac6f-4885-9139-91aa94defa88 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:29.804568 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-26e60e03-ac6f-4885-9139-91aa94defa88 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:29.811878 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-26e60e03-ac6f-4885-9139-91aa94defa88 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:29.812568 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-26e60e03-ac6f-4885-9139-91aa94defa88 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:29.813175 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-26e60e03-ac6f-4885-9139-91aa94defa88 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:29.813905 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-26e60e03-ac6f-4885-9139-91aa94defa88 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:29.814209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-af7ec4f9-affa-4439-a9dd-b14fbd4dcdf7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:29.814352 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-26e60e03-ac6f-4885-9139-91aa94defa88 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:29.814768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-26e60e03-ac6f-4885-9139-91aa94defa88 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:29.823846 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-af7ec4f9-affa-4439-a9dd-b14fbd4dcdf7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:29.825318 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-af7ec4f9-affa-4439-a9dd-b14fbd4dcdf7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:29.826505 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-af7ec4f9-affa-4439-a9dd-b14fbd4dcdf7 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1725 microversion: 2.20 time: 0.166630 Aug 31 11:54:29.827251 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 608/1199] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:54:29 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:54:30.065102 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-26e60e03-ac6f-4885-9139-91aa94defa88 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:30.073582 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-26e60e03-ac6f-4885-9139-91aa94defa88 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1261 microversion: 2.1 time: 0.275022 Aug 31 11:54:30.074148 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 592/1200] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:29 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1261 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:54:30.409969 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6e406235-21ca-4285-a14d-e75abfc3c13b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:30.412930 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6e406235-21ca-4285-a14d-e75abfc3c13b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:30.420961 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e406235-21ca-4285-a14d-e75abfc3c13b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:30.421920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e406235-21ca-4285-a14d-e75abfc3c13b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:30.422831 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e406235-21ca-4285-a14d-e75abfc3c13b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:30.423940 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e406235-21ca-4285-a14d-e75abfc3c13b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:30.424527 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e406235-21ca-4285-a14d-e75abfc3c13b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:30.425050 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6e406235-21ca-4285-a14d-e75abfc3c13b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:30.463081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6e406235-21ca-4285-a14d-e75abfc3c13b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057255 Aug 31 11:54:30.463866 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 609/1201] 10.222.0.60 () {58 vars in 1302 bytes} [Wed Aug 31 11:54:30 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:54:30.533272 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8a8fe514-6fb7-428b-971c-9c186babeb9a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:30.533812 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8a8fe514-6fb7-428b-971c-9c186babeb9a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:30.541345 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8a8fe514-6fb7-428b-971c-9c186babeb9a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:30.541892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8a8fe514-6fb7-428b-971c-9c186babeb9a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:30.542329 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8a8fe514-6fb7-428b-971c-9c186babeb9a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:30.543028 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8a8fe514-6fb7-428b-971c-9c186babeb9a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:30.543472 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8a8fe514-6fb7-428b-971c-9c186babeb9a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:30.543892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8a8fe514-6fb7-428b-971c-9c186babeb9a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:30.572729 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8a8fe514-6fb7-428b-971c-9c186babeb9a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Going to try to terminate instance {{(pid=127061) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:54:30.656844 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8a8fe514-6fb7-428b-971c-9c186babeb9a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "DELETE /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 204 len: 0 microversion: 2.1 time: 0.127352 Aug 31 11:54:30.657552 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 593/1202] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:54:30 2022] DELETE /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:54:30.666701 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f3765e8a-e979-4184-9400-bba1fcad5e5a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:30.667951 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f3765e8a-e979-4184-9400-bba1fcad5e5a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:30.683510 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3765e8a-e979-4184-9400-bba1fcad5e5a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:30.684166 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3765e8a-e979-4184-9400-bba1fcad5e5a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:30.684670 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3765e8a-e979-4184-9400-bba1fcad5e5a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:30.685545 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3765e8a-e979-4184-9400-bba1fcad5e5a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:30.686146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3765e8a-e979-4184-9400-bba1fcad5e5a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:30.686563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f3765e8a-e979-4184-9400-bba1fcad5e5a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:30.828647 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f3765e8a-e979-4184-9400-bba1fcad5e5a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:30.836532 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f3765e8a-e979-4184-9400-bba1fcad5e5a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1682 microversion: 2.1 time: 0.174094 Aug 31 11:54:30.837375 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 610/1203] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:30 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:30.860093 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-291e123e-17fe-405e-b0ac-bbbad9164f28 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:30.860883 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-291e123e-17fe-405e-b0ac-bbbad9164f28 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:30.867678 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-291e123e-17fe-405e-b0ac-bbbad9164f28 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:30.868965 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-291e123e-17fe-405e-b0ac-bbbad9164f28 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:30.869357 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-291e123e-17fe-405e-b0ac-bbbad9164f28 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:30.870935 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-291e123e-17fe-405e-b0ac-bbbad9164f28 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:30.874263 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-291e123e-17fe-405e-b0ac-bbbad9164f28 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:30.874263 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-291e123e-17fe-405e-b0ac-bbbad9164f28 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:30.929712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-bd8a6597-1eef-464d-8b80-0bc75cdc99fb req-ea233d60-ba3f-4cef-8cec-ede3b572d2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06aad3ea-8a4f-44c5-829c-b0230807fdf7", "name": "network-vif-deleted", "tag": "936e8033-671c-4a3d-9abe-a63045a10877"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:54:30.942908 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-bd8a6597-1eef-464d-8b80-0bc75cdc99fb req-ea233d60-ba3f-4cef-8cec-ede3b572d2e7 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:30.943876 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-bd8a6597-1eef-464d-8b80-0bc75cdc99fb req-ea233d60-ba3f-4cef-8cec-ede3b572d2e7 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:30.944375 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-bd8a6597-1eef-464d-8b80-0bc75cdc99fb req-ea233d60-ba3f-4cef-8cec-ede3b572d2e7 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:30.955769 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-291e123e-17fe-405e-b0ac-bbbad9164f28 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:30.965744 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-bd8a6597-1eef-464d-8b80-0bc75cdc99fb req-ea233d60-ba3f-4cef-8cec-ede3b572d2e7 service nova] Creating event network-vif-deleted:936e8033-671c-4a3d-9abe-a63045a10877 for instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 on hv-cinder-83976 Aug 31 11:54:30.966314 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-291e123e-17fe-405e-b0ac-bbbad9164f28 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:30.967857 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-291e123e-17fe-405e-b0ac-bbbad9164f28 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:30.969198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-291e123e-17fe-405e-b0ac-bbbad9164f28 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1657 microversion: 2.20 time: 0.113924 Aug 31 11:54:30.971211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 594/1204] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:54:30 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1657 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:54:30.972904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-bd8a6597-1eef-464d-8b80-0bc75cdc99fb req-ea233d60-ba3f-4cef-8cec-ede3b572d2e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052690 Aug 31 11:54:30.973916 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 611/1205] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:31.095464 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-48f2f32e-db6e-42bb-a223-df007c96e1ea tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:31.096244 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-48f2f32e-db6e-42bb-a223-df007c96e1ea tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:31.105472 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-48f2f32e-db6e-42bb-a223-df007c96e1ea tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:31.107396 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-48f2f32e-db6e-42bb-a223-df007c96e1ea tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:31.107857 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-48f2f32e-db6e-42bb-a223-df007c96e1ea tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:31.108672 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-48f2f32e-db6e-42bb-a223-df007c96e1ea tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:31.109290 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-48f2f32e-db6e-42bb-a223-df007c96e1ea tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:31.109872 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-48f2f32e-db6e-42bb-a223-df007c96e1ea tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:31.253782 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-48f2f32e-db6e-42bb-a223-df007c96e1ea tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:31.262701 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-48f2f32e-db6e-42bb-a223-df007c96e1ea tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1261 microversion: 2.1 time: 0.171162 Aug 31 11:54:31.263330 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 595/1206] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:31 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:31.874373 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d8ca4314-1d59-46e5-b914-2acb3209bfe8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:31.875495 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d8ca4314-1d59-46e5-b914-2acb3209bfe8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:31.887131 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8ca4314-1d59-46e5-b914-2acb3209bfe8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:31.890937 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8ca4314-1d59-46e5-b914-2acb3209bfe8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:31.893548 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8ca4314-1d59-46e5-b914-2acb3209bfe8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:31.894671 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8ca4314-1d59-46e5-b914-2acb3209bfe8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:31.895521 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8ca4314-1d59-46e5-b914-2acb3209bfe8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:31.895990 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d8ca4314-1d59-46e5-b914-2acb3209bfe8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:32.005841 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:32.009706 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:32.020053 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:32.020880 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:32.021580 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:32.022710 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:32.023543 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:32.024314 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:32.083270 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d8ca4314-1d59-46e5-b914-2acb3209bfe8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:32.092456 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d8ca4314-1d59-46e5-b914-2acb3209bfe8 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1682 microversion: 2.1 time: 0.230579 Aug 31 11:54:32.096555 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 612/1207] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:31 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:32.096909 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:32.096909 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:32.097205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:32.097912 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lazy-loading 'fault' on Instance uuid 06aad3ea-8a4f-44c5-829c-b0230807fdf7 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:54:32.143886 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:32.149972 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:54:32.159837 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:32.164272 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bcd4602a40964a81931cdadc92d7f281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23acf169856c41d888a1d4c0e61cfee2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:32.166209 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-56d5af19-dde2-4ea5-8c53-886059190c4a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 200 len: 1371 microversion: 2.20 time: 0.176924 Aug 31 11:54:32.166946 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 596/1208] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:54:31 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:54:32.287345 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c16751e7-43ad-4b16-a224-c05f4b8bea61 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:32.288651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c16751e7-43ad-4b16-a224-c05f4b8bea61 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:32.296370 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c16751e7-43ad-4b16-a224-c05f4b8bea61 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:32.296886 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c16751e7-43ad-4b16-a224-c05f4b8bea61 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:32.297326 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c16751e7-43ad-4b16-a224-c05f4b8bea61 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:32.298143 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c16751e7-43ad-4b16-a224-c05f4b8bea61 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:32.298632 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c16751e7-43ad-4b16-a224-c05f4b8bea61 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:32.299084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c16751e7-43ad-4b16-a224-c05f4b8bea61 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:32.460280 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c16751e7-43ad-4b16-a224-c05f4b8bea61 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:32.470413 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c16751e7-43ad-4b16-a224-c05f4b8bea61 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1261 microversion: 2.1 time: 0.188654 Aug 31 11:54:32.470993 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 613/1209] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:32 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:33.120606 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-29ef6c6c-d58a-455f-ad42-4cf4a10ddb8f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:33.120606 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-29ef6c6c-d58a-455f-ad42-4cf4a10ddb8f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:33.127510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29ef6c6c-d58a-455f-ad42-4cf4a10ddb8f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:33.127510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29ef6c6c-d58a-455f-ad42-4cf4a10ddb8f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:33.127510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29ef6c6c-d58a-455f-ad42-4cf4a10ddb8f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:33.127510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29ef6c6c-d58a-455f-ad42-4cf4a10ddb8f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:33.127883 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29ef6c6c-d58a-455f-ad42-4cf4a10ddb8f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:33.127883 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-29ef6c6c-d58a-455f-ad42-4cf4a10ddb8f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:33.188756 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-21f7d2e5-5010-4916-81cd-dee831b6536f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:33.189366 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-21f7d2e5-5010-4916-81cd-dee831b6536f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:33.197891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21f7d2e5-5010-4916-81cd-dee831b6536f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:33.198487 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21f7d2e5-5010-4916-81cd-dee831b6536f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:33.198979 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21f7d2e5-5010-4916-81cd-dee831b6536f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:33.199677 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21f7d2e5-5010-4916-81cd-dee831b6536f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:33.200160 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21f7d2e5-5010-4916-81cd-dee831b6536f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:33.200622 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-21f7d2e5-5010-4916-81cd-dee831b6536f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:33.215754 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-21f7d2e5-5010-4916-81cd-dee831b6536f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] HTTP exception thrown: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-21f7d2e5-5010-4916-81cd-dee831b6536f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Request method failure captured: Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 HTTP/1.1 Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lJpcTrn2pLuUpyWlfyBmJ8Vt5JJ3uQ9jN10mg0OVovMDnoYwXIZjXocsPXhMukVZty2BNiMkG0ANSlP-GAoSzVorz2e1TgtDzD_qYmy-Suxl3bSzErwIE2aUzE2pM9oyHzJ8M5qSQa0NIp5D2BabPWHbiCz8IFK2W7BE_NlZj6M7o Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 23acf169856c41d888a1d4c0e61cfee2 Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:54:33.217338 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:54:33.219301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_23acf169856c41d888a1d4c0e61cfee2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/23acf169856c41d888a1d4c0e61cfee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23acf169856c41d888a1d4c0e61cfee2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23acf169856c41d888a1d4c0e61cfee2"}]}] Aug 31 11:54:33.219301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:54:33.219301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 23acf169856c41d888a1d4c0e61cfee2 Aug 31 11:54:33.219301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:54:33.219301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-AttachVolumeShelveTestJSON-910663346-project Aug 31 11:54:33.219301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:54:33.219301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:54:33.219301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: bcd4602a40964a81931cdadc92d7f281 Aug 31 11:54:33.219301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-AttachVolumeShelveTestJSON-910663346-project Aug 31 11:54:33.219301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:54:33.219301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. Aug 31 11:54:33.219301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': '06aad3ea-8a4f-44c5-829c-b0230807fdf7'} Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:54:33.224026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. Aug 31 11:54:33.225769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:33.227339 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-21f7d2e5-5010-4916-81cd-dee831b6536f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Returning 404 to user: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:54:33.227339 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-21f7d2e5-5010-4916-81cd-dee831b6536f tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 404 len: 111 microversion: 2.20 time: 0.033929 Aug 31 11:54:33.227339 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 614/1210] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:54:33 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 11:54:33.229158 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b243756e-53d6-40af-b762-3bb9fd268363 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '.version_select at 0x7f1734a455e0>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:33.257358 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b243756e-53d6-40af-b762-3bb9fd268363 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-832228715" status: 204 len: 0 microversion: 2.20 time: 0.033124 Aug 31 11:54:33.258784 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 615/1211] 10.222.0.60 () {60 vars in 1259 bytes} [Wed Aug 31 11:54:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-832228715 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 11:54:33.381659 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-29ef6c6c-d58a-455f-ad42-4cf4a10ddb8f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:33.394677 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-29ef6c6c-d58a-455f-ad42-4cf4a10ddb8f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1682 microversion: 2.1 time: 0.283175 Aug 31 11:54:33.395259 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 597/1212] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:33 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1682 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:54:33.491746 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-842fc224-8d61-4956-a9b0-fa37bad90eb8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:33.492357 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-842fc224-8d61-4956-a9b0-fa37bad90eb8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:33.501591 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-842fc224-8d61-4956-a9b0-fa37bad90eb8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:33.502388 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-842fc224-8d61-4956-a9b0-fa37bad90eb8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:33.503261 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-842fc224-8d61-4956-a9b0-fa37bad90eb8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:33.503887 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-842fc224-8d61-4956-a9b0-fa37bad90eb8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:33.504650 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-842fc224-8d61-4956-a9b0-fa37bad90eb8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:33.504650 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-842fc224-8d61-4956-a9b0-fa37bad90eb8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:33.787074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-4b681ad2-7549-467b-8ad1-0142f678dbcf req-9304622b-0710-48fe-9598-3c8473ba1aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "052cfef0-621e-4a5e-bb48-b0bd7b753e18", "name": "network-vif-deleted", "tag": "8eb80210-6f21-43d5-a6f8-dc5fc8e72708"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:54:33.794092 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:54:33.794771 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=6 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:54:33.803139 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-4b681ad2-7549-467b-8ad1-0142f678dbcf req-9304622b-0710-48fe-9598-3c8473ba1aa9 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:33.805477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-4b681ad2-7549-467b-8ad1-0142f678dbcf req-9304622b-0710-48fe-9598-3c8473ba1aa9 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:33.805477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-4b681ad2-7549-467b-8ad1-0142f678dbcf req-9304622b-0710-48fe-9598-3c8473ba1aa9 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:33.830712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:54:33.841022 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-4b681ad2-7549-467b-8ad1-0142f678dbcf req-9304622b-0710-48fe-9598-3c8473ba1aa9 service nova] Creating event network-vif-deleted:8eb80210-6f21-43d5-a6f8-dc5fc8e72708 for instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 on hv-cinder-83976 Aug 31 11:54:33.848061 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-4b681ad2-7549-467b-8ad1-0142f678dbcf req-9304622b-0710-48fe-9598-3c8473ba1aa9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070245 Aug 31 11:54:33.849319 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 598/1213] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:54:33.908134 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-842fc224-8d61-4956-a9b0-fa37bad90eb8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:33.924347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-842fc224-8d61-4956-a9b0-fa37bad90eb8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1261 microversion: 2.1 time: 0.436288 Aug 31 11:54:33.926136 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 616/1214] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:33 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1261 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:54:34.417598 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6ac3ba5d-2a2d-4c80-aa04-b0f3c2ec8c04 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:34.418297 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6ac3ba5d-2a2d-4c80-aa04-b0f3c2ec8c04 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:34.427878 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3ba5d-2a2d-4c80-aa04-b0f3c2ec8c04 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:34.431439 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3ba5d-2a2d-4c80-aa04-b0f3c2ec8c04 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:34.433050 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3ba5d-2a2d-4c80-aa04-b0f3c2ec8c04 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:34.436695 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3ba5d-2a2d-4c80-aa04-b0f3c2ec8c04 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:34.437519 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3ba5d-2a2d-4c80-aa04-b0f3c2ec8c04 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:34.438054 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3ba5d-2a2d-4c80-aa04-b0f3c2ec8c04 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:34.497941 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3ba5d-2a2d-4c80-aa04-b0f3c2ec8c04 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:34.498538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3ba5d-2a2d-4c80-aa04-b0f3c2ec8c04 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:34.499318 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6ac3ba5d-2a2d-4c80-aa04-b0f3c2ec8c04 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:34.500322 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-6ac3ba5d-2a2d-4c80-aa04-b0f3c2ec8c04 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lazy-loading 'fault' on Instance uuid 052cfef0-621e-4a5e-bb48-b0bd7b753e18 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:54:34.558563 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6ac3ba5d-2a2d-4c80-aa04-b0f3c2ec8c04 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de832888ffd4a69ae88cac6b632304e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ac4dc41f7e420d811483990e020f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:34.568578 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6ac3ba5d-2a2d-4c80-aa04-b0f3c2ec8c04 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 200 len: 1332 microversion: 2.1 time: 0.155519 Aug 31 11:54:34.569233 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 599/1215] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:34 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 1332 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:34.955417 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8307f62e-b179-4d5e-ae8a-950b608f7c3b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:34.956039 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8307f62e-b179-4d5e-ae8a-950b608f7c3b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:34.964842 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8307f62e-b179-4d5e-ae8a-950b608f7c3b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:34.965333 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8307f62e-b179-4d5e-ae8a-950b608f7c3b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:34.965763 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8307f62e-b179-4d5e-ae8a-950b608f7c3b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:34.966504 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8307f62e-b179-4d5e-ae8a-950b608f7c3b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:34.966945 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8307f62e-b179-4d5e-ae8a-950b608f7c3b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:34.967357 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8307f62e-b179-4d5e-ae8a-950b608f7c3b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:35.139826 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8307f62e-b179-4d5e-ae8a-950b608f7c3b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:35.147668 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8307f62e-b179-4d5e-ae8a-950b608f7c3b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1261 microversion: 2.1 time: 0.196110 Aug 31 11:54:35.148251 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 617/1216] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:34 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1261 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:35.591197 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e3b7b78d-345a-4fbd-ab91-0d9d446ee518 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:35.591797 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e3b7b78d-345a-4fbd-ab91-0d9d446ee518 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:35.598098 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e3b7b78d-345a-4fbd-ab91-0d9d446ee518 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:35.598775 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e3b7b78d-345a-4fbd-ab91-0d9d446ee518 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:35.599207 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e3b7b78d-345a-4fbd-ab91-0d9d446ee518 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:35.599881 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e3b7b78d-345a-4fbd-ab91-0d9d446ee518 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:35.600323 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e3b7b78d-345a-4fbd-ab91-0d9d446ee518 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:35.600766 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e3b7b78d-345a-4fbd-ab91-0d9d446ee518 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:35.614576 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-e3b7b78d-345a-4fbd-ab91-0d9d446ee518 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] HTTP exception thrown: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e3b7b78d-345a-4fbd-ab91-0d9d446ee518 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Request method failure captured: Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 HTTP/1.1 Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lNZK36WRJOqsZNJl20dtBROIhvCChjxxXw9hostbElDCeoQYmhRnMS-kPydTDnhED92nvTRK2Z-mbhSicQnNG72V_XHtUyBJEP0Dy5LBQs28qt-qUXpO9451h3L1SwnxBkofz4240mv6LO2saJFZwry8omihvYKRxBlQ5VwAkEiuA Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:54:35.616193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:54:35.617931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4ac4dc41f7e420d811483990e020f22", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}] Aug 31 11:54:35.617931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:35.617931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:35.617931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:35.617931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:35.617931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:54:35.617931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:54:35.617931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 5de832888ffd4a69ae88cac6b632304e Aug 31 11:54:35.617931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:35.617931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:54:35.617931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. Aug 31 11:54:35.617931 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '052cfef0-621e-4a5e-bb48-b0bd7b753e18'} Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:54:35.619056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. Aug 31 11:54:35.620743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:35.622198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e3b7b78d-345a-4fbd-ab91-0d9d446ee518 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Returning 404 to user: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:54:35.622198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e3b7b78d-345a-4fbd-ab91-0d9d446ee518 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 404 len: 111 microversion: 2.1 time: 0.030382 Aug 31 11:54:35.622198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 600/1217] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:35 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:54:35.626980 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b4f2eff3-96cc-402f-b96b-2b87d8099f4a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '.version_select at 0x7f1734a45ee0>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:35.645762 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b4f2eff3-96cc-402f-b96b-2b87d8099f4a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816970512" status: 202 len: 0 microversion: 2.1 time: 0.022503 Aug 31 11:54:35.646319 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 618/1218] 10.222.0.60 () {58 vars in 1221 bytes} [Wed Aug 31 11:54:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816970512 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:54:36.169757 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a4ccaedb-f6c0-4908-bfb9-501e7d2ff3a1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:36.170365 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a4ccaedb-f6c0-4908-bfb9-501e7d2ff3a1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:36.176431 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a4ccaedb-f6c0-4908-bfb9-501e7d2ff3a1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:36.176950 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a4ccaedb-f6c0-4908-bfb9-501e7d2ff3a1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:36.177379 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a4ccaedb-f6c0-4908-bfb9-501e7d2ff3a1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:36.178081 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a4ccaedb-f6c0-4908-bfb9-501e7d2ff3a1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:36.178525 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a4ccaedb-f6c0-4908-bfb9-501e7d2ff3a1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:36.178947 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a4ccaedb-f6c0-4908-bfb9-501e7d2ff3a1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:36.403217 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a4ccaedb-f6c0-4908-bfb9-501e7d2ff3a1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:36.411397 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a4ccaedb-f6c0-4908-bfb9-501e7d2ff3a1 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1261 microversion: 2.1 time: 0.245600 Aug 31 11:54:36.412348 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 601/1219] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:36 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1261 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:54:37.433949 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-05d374fd-cb68-4705-8f68-70c8ae2e3c76 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:37.434582 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-05d374fd-cb68-4705-8f68-70c8ae2e3c76 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:37.441006 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-05d374fd-cb68-4705-8f68-70c8ae2e3c76 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:37.441486 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-05d374fd-cb68-4705-8f68-70c8ae2e3c76 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:37.441917 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-05d374fd-cb68-4705-8f68-70c8ae2e3c76 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:37.442599 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-05d374fd-cb68-4705-8f68-70c8ae2e3c76 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:37.443303 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-05d374fd-cb68-4705-8f68-70c8ae2e3c76 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:37.443733 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-05d374fd-cb68-4705-8f68-70c8ae2e3c76 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:37.582594 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-05d374fd-cb68-4705-8f68-70c8ae2e3c76 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:37.592991 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-05d374fd-cb68-4705-8f68-70c8ae2e3c76 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1261 microversion: 2.1 time: 0.163271 Aug 31 11:54:37.593817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 619/1220] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:37 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:38.616625 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4fb6dd72-8948-4725-9588-759bfa06cf79 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:38.617476 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4fb6dd72-8948-4725-9588-759bfa06cf79 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:38.624815 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4fb6dd72-8948-4725-9588-759bfa06cf79 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:38.625297 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4fb6dd72-8948-4725-9588-759bfa06cf79 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:38.625720 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4fb6dd72-8948-4725-9588-759bfa06cf79 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:38.626415 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4fb6dd72-8948-4725-9588-759bfa06cf79 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:38.626856 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4fb6dd72-8948-4725-9588-759bfa06cf79 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:38.627270 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4fb6dd72-8948-4725-9588-759bfa06cf79 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:38.766364 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4fb6dd72-8948-4725-9588-759bfa06cf79 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:38.773930 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4fb6dd72-8948-4725-9588-759bfa06cf79 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1261 microversion: 2.1 time: 0.161409 Aug 31 11:54:38.774484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 602/1221] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:38 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:39.670052 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9f8a71e4-a26d-4bbe-9023-368fcc70db71 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:39.670584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-9f8a71e4-a26d-4bbe-9023-368fcc70db71 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:39.677096 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9f8a71e4-a26d-4bbe-9023-368fcc70db71 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:39.677435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9f8a71e4-a26d-4bbe-9023-368fcc70db71 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:39.677901 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9f8a71e4-a26d-4bbe-9023-368fcc70db71 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:39.678597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9f8a71e4-a26d-4bbe-9023-368fcc70db71 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:39.679040 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9f8a71e4-a26d-4bbe-9023-368fcc70db71 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:39.679458 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-9f8a71e4-a26d-4bbe-9023-368fcc70db71 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:39.693475 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-9f8a71e4-a26d-4bbe-9023-368fcc70db71 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] HTTP exception thrown: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9f8a71e4-a26d-4bbe-9023-368fcc70db71 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Request method failure captured: Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: DELETE /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 HTTP/1.1 Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lNZK36WRJOqsZNJl20dtBROIhvCChjxxXw9hostbElDCeoQYmhRnMS-kPydTDnhED92nvTRK2Z-mbhSicQnNG72V_XHtUyBJEP0Dy5LBQs28qt-qUXpO9451h3L1SwnxBkofz4240mv6LO2saJFZwry8omihvYKRxBlQ5VwAkEiuA Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:54:39.695065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:54:39.696900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4ac4dc41f7e420d811483990e020f22", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}] Aug 31 11:54:39.696900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:39.696900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:39.696900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:39.696900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:39.696900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:54:39.696900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:54:39.696900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 5de832888ffd4a69ae88cac6b632304e Aug 31 11:54:39.696900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:39.696900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:54:39.696900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. Aug 31 11:54:39.696900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': '052cfef0-621e-4a5e-bb48-b0bd7b753e18'} Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:54:39.697700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. Aug 31 11:54:39.699035 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.701456 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-9f8a71e4-a26d-4bbe-9023-368fcc70db71 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Returning 404 to user: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:54:39.701456 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-9f8a71e4-a26d-4bbe-9023-368fcc70db71 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "DELETE /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 404 len: 111 microversion: 2.1 time: 0.030273 Aug 31 11:54:39.701456 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 620/1222] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:54:39 2022] DELETE /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:54:39.705614 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bbe3d67b-083a-4f2c-a2aa-456ac11b0d7f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:39.706260 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-bbe3d67b-083a-4f2c-a2aa-456ac11b0d7f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 052cfef0-621e-4a5e-bb48-b0bd7b753e18] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:39.713640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbe3d67b-083a-4f2c-a2aa-456ac11b0d7f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:39.714155 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbe3d67b-083a-4f2c-a2aa-456ac11b0d7f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:39.714702 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbe3d67b-083a-4f2c-a2aa-456ac11b0d7f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:39.715412 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbe3d67b-083a-4f2c-a2aa-456ac11b0d7f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:39.715896 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbe3d67b-083a-4f2c-a2aa-456ac11b0d7f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:39.716401 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bbe3d67b-083a-4f2c-a2aa-456ac11b0d7f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:39.731669 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-bbe3d67b-083a-4f2c-a2aa-456ac11b0d7f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] HTTP exception thrown: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bbe3d67b-083a-4f2c-a2aa-456ac11b0d7f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Request method failure captured: Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 HTTP/1.1 Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lNZK36WRJOqsZNJl20dtBROIhvCChjxxXw9hostbElDCeoQYmhRnMS-kPydTDnhED92nvTRK2Z-mbhSicQnNG72V_XHtUyBJEP0Dy5LBQs28qt-qUXpO9451h3L1SwnxBkofz4240mv6LO2saJFZwry8omihvYKRxBlQ5VwAkEiuA Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:54:39.733234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:54:39.734910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4ac4dc41f7e420d811483990e020f22", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}] Aug 31 11:54:39.734910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:39.734910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:39.734910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:39.734910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:39.734910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:54:39.734910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:54:39.734910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 5de832888ffd4a69ae88cac6b632304e Aug 31 11:54:39.734910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:39.734910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:54:39.734910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. Aug 31 11:54:39.734910 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '052cfef0-621e-4a5e-bb48-b0bd7b753e18'} Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:54:39.736042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. Aug 31 11:54:39.739211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.740739 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bbe3d67b-083a-4f2c-a2aa-456ac11b0d7f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Returning 404 to user: Instance 052cfef0-621e-4a5e-bb48-b0bd7b753e18 could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:54:39.740739 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-bbe3d67b-083a-4f2c-a2aa-456ac11b0d7f tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18" status: 404 len: 111 microversion: 2.1 time: 0.032875 Aug 31 11:54:39.740739 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 603/1223] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:39 2022] GET /compute/v2.1/servers/052cfef0-621e-4a5e-bb48-b0bd7b753e18 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:54:39.794178 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-daaaff1f-89a4-4430-ab94-2acef9f1f2bc tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:39.795604 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-daaaff1f-89a4-4430-ab94-2acef9f1f2bc tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:39.806246 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-daaaff1f-89a4-4430-ab94-2acef9f1f2bc tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:39.806946 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-daaaff1f-89a4-4430-ab94-2acef9f1f2bc tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:39.807812 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-daaaff1f-89a4-4430-ab94-2acef9f1f2bc tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:39.808526 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-daaaff1f-89a4-4430-ab94-2acef9f1f2bc tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:39.809178 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-daaaff1f-89a4-4430-ab94-2acef9f1f2bc tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:39.809853 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-daaaff1f-89a4-4430-ab94-2acef9f1f2bc tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:39.814931 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:54:39.833422 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bfcd42f9-7263-442c-9adb-7cb760958d39 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:39.834189 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-bfcd42f9-7263-442c-9adb-7cb760958d39 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:39.845856 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bfcd42f9-7263-442c-9adb-7cb760958d39 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:39.846641 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bfcd42f9-7263-442c-9adb-7cb760958d39 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:39.847664 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bfcd42f9-7263-442c-9adb-7cb760958d39 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:39.849178 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bfcd42f9-7263-442c-9adb-7cb760958d39 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:39.850455 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bfcd42f9-7263-442c-9adb-7cb760958d39 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:39.851071 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bfcd42f9-7263-442c-9adb-7cb760958d39 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:39.884688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-bfcd42f9-7263-442c-9adb-7cb760958d39 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] HTTP exception thrown: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bfcd42f9-7263-442c-9adb-7cb760958d39 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Request method failure captured: Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: DELETE /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 HTTP/1.1 Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lJpcTrn2pLuUpyWlfyBmJ8Vt5JJ3uQ9jN10mg0OVovMDnoYwXIZjXocsPXhMukVZty2BNiMkG0ANSlP-GAoSzVorz2e1TgtDzD_qYmy-Suxl3bSzErwIE2aUzE2pM9oyHzJ8M5qSQa0NIp5D2BabPWHbiCz8IFK2W7BE_NlZj6M7o Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: 23acf169856c41d888a1d4c0e61cfee2 Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:54:39.886835 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:54:39.888894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_23acf169856c41d888a1d4c0e61cfee2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/23acf169856c41d888a1d4c0e61cfee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23acf169856c41d888a1d4c0e61cfee2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23acf169856c41d888a1d4c0e61cfee2"}]}] Aug 31 11:54:39.888894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:54:39.888894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: 23acf169856c41d888a1d4c0e61cfee2 Aug 31 11:54:39.888894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:54:39.888894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-AttachVolumeShelveTestJSON-910663346-project Aug 31 11:54:39.888894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:54:39.888894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:54:39.888894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: bcd4602a40964a81931cdadc92d7f281 Aug 31 11:54:39.888894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-AttachVolumeShelveTestJSON-910663346-project Aug 31 11:54:39.888894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:54:39.888894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. Aug 31 11:54:39.888894 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '06aad3ea-8a4f-44c5-829c-b0230807fdf7'} Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:54:39.890288 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. Aug 31 11:54:39.891970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.893658 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bfcd42f9-7263-442c-9adb-7cb760958d39 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Returning 404 to user: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:54:39.893658 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-bfcd42f9-7263-442c-9adb-7cb760958d39 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "DELETE /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 404 len: 111 microversion: 2.20 time: 0.063825 Aug 31 11:54:39.893658 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 604/1224] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Aug 31 11:54:39 2022] DELETE /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:54:39.899669 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-66292aa6-599c-4c13-b7c3-504b7c2e675a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:39.900106 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-66292aa6-599c-4c13-b7c3-504b7c2e675a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06aad3ea-8a4f-44c5-829c-b0230807fdf7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:39.907427 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-66292aa6-599c-4c13-b7c3-504b7c2e675a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:39.908162 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-66292aa6-599c-4c13-b7c3-504b7c2e675a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:39.908538 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-66292aa6-599c-4c13-b7c3-504b7c2e675a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:39.909307 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-66292aa6-599c-4c13-b7c3-504b7c2e675a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:39.909963 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-66292aa6-599c-4c13-b7c3-504b7c2e675a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:39.910435 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-66292aa6-599c-4c13-b7c3-504b7c2e675a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:39.927443 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-66292aa6-599c-4c13-b7c3-504b7c2e675a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] HTTP exception thrown: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-66292aa6-599c-4c13-b7c3-504b7c2e675a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Request method failure captured: Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 HTTP/1.1 Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lJpcTrn2pLuUpyWlfyBmJ8Vt5JJ3uQ9jN10mg0OVovMDnoYwXIZjXocsPXhMukVZty2BNiMkG0ANSlP-GAoSzVorz2e1TgtDzD_qYmy-Suxl3bSzErwIE2aUzE2pM9oyHzJ8M5qSQa0NIp5D2BabPWHbiCz8IFK2W7BE_NlZj6M7o Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: 23acf169856c41d888a1d4c0e61cfee2 Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:54:39.929334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:54:39.931821 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_23acf169856c41d888a1d4c0e61cfee2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/23acf169856c41d888a1d4c0e61cfee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23acf169856c41d888a1d4c0e61cfee2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23acf169856c41d888a1d4c0e61cfee2"}]}] Aug 31 11:54:39.931821 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:54:39.931821 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: 23acf169856c41d888a1d4c0e61cfee2 Aug 31 11:54:39.931821 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:54:39.931821 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-AttachVolumeShelveTestJSON-910663346-project Aug 31 11:54:39.931821 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:54:39.931821 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:54:39.931821 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: bcd4602a40964a81931cdadc92d7f281 Aug 31 11:54:39.931821 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-AttachVolumeShelveTestJSON-910663346-project Aug 31 11:54:39.931821 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:54:39.931821 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. Aug 31 11:54:39.931821 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '06aad3ea-8a4f-44c5-829c-b0230807fdf7'} Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:54:39.932933 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. Aug 31 11:54:39.934168 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:39.936949 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-66292aa6-599c-4c13-b7c3-504b7c2e675a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Returning 404 to user: Instance 06aad3ea-8a4f-44c5-829c-b0230807fdf7 could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:54:39.938118 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-66292aa6-599c-4c13-b7c3-504b7c2e675a tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7" status: 404 len: 111 microversion: 2.20 time: 0.043296 Aug 31 11:54:39.942019 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 605/1225] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:54:39 2022] GET /compute/v2.1/servers/06aad3ea-8a4f-44c5-829c-b0230807fdf7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:54:39.979689 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-daaaff1f-89a4-4430-ab94-2acef9f1f2bc tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:39.988590 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-daaaff1f-89a4-4430-ab94-2acef9f1f2bc tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1261 microversion: 2.1 time: 0.198058 Aug 31 11:54:40.002193 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 621/1226] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:39 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1261 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:40.912274 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-cd7809c8-1570-41e7-a50a-f1f33c15f2c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:40.912890 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-cd7809c8-1570-41e7-a50a-f1f33c15f2c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:40.920745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cd7809c8-1570-41e7-a50a-f1f33c15f2c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:40.921238 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cd7809c8-1570-41e7-a50a-f1f33c15f2c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:40.921677 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cd7809c8-1570-41e7-a50a-f1f33c15f2c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:40.922406 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cd7809c8-1570-41e7-a50a-f1f33c15f2c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:40.922856 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cd7809c8-1570-41e7-a50a-f1f33c15f2c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:40.923277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-cd7809c8-1570-41e7-a50a-f1f33c15f2c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:40.938962 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-cd7809c8-1570-41e7-a50a-f1f33c15f2c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] HTTP exception thrown: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-cd7809c8-1570-41e7-a50a-f1f33c15f2c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Request method failure captured: Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: DELETE /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda HTTP/1.1 Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lNZK36WRJOqsZNJl20dtBROIhvCChjxxXw9hostbElDCeoQYmhRnMS-kPydTDnhED92nvTRK2Z-mbhSicQnNG72V_XHtUyBJEP0Dy5LBQs28qt-qUXpO9451h3L1SwnxBkofz4240mv6LO2saJFZwry8omihvYKRxBlQ5VwAkEiuA Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:54:40.940437 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:54:40.941884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4ac4dc41f7e420d811483990e020f22", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}] Aug 31 11:54:40.941884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:40.941884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:40.941884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:40.941884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:40.941884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:54:40.941884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:54:40.941884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 5de832888ffd4a69ae88cac6b632304e Aug 31 11:54:40.941884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:40.941884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:54:40.941884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. Aug 31 11:54:40.941884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '95a8e93a-cf62-4e41-98c8-a824827b2fda'} Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:54:40.943277 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. Aug 31 11:54:40.944804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:40.946234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-cd7809c8-1570-41e7-a50a-f1f33c15f2c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Returning 404 to user: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:54:40.946234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-cd7809c8-1570-41e7-a50a-f1f33c15f2c3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "DELETE /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 404 len: 111 microversion: 2.1 time: 0.033741 Aug 31 11:54:40.946234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 606/1227] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:54:40 2022] DELETE /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:54:40.950804 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b5ca3497-2963-4847-9ac0-f2816850bea5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:40.951414 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b5ca3497-2963-4847-9ac0-f2816850bea5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 95a8e93a-cf62-4e41-98c8-a824827b2fda] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:40.957897 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5ca3497-2963-4847-9ac0-f2816850bea5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:40.958372 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5ca3497-2963-4847-9ac0-f2816850bea5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:40.958803 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5ca3497-2963-4847-9ac0-f2816850bea5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:40.959487 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5ca3497-2963-4847-9ac0-f2816850bea5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:40.959933 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5ca3497-2963-4847-9ac0-f2816850bea5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:40.960353 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b5ca3497-2963-4847-9ac0-f2816850bea5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:40.974489 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-b5ca3497-2963-4847-9ac0-f2816850bea5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] HTTP exception thrown: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b5ca3497-2963-4847-9ac0-f2816850bea5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Request method failure captured: Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda HTTP/1.1 Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lNZK36WRJOqsZNJl20dtBROIhvCChjxxXw9hostbElDCeoQYmhRnMS-kPydTDnhED92nvTRK2Z-mbhSicQnNG72V_XHtUyBJEP0Dy5LBQs28qt-qUXpO9451h3L1SwnxBkofz4240mv6LO2saJFZwry8omihvYKRxBlQ5VwAkEiuA Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:54:40.976026 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:54:40.978215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4ac4dc41f7e420d811483990e020f22", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}] Aug 31 11:54:40.978215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:40.978215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:40.978215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:40.978215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:40.978215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:54:40.978215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:54:40.978215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 5de832888ffd4a69ae88cac6b632304e Aug 31 11:54:40.978215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:40.978215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:54:40.978215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. Aug 31 11:54:40.978215 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': '95a8e93a-cf62-4e41-98c8-a824827b2fda'} Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:54:40.979148 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. Aug 31 11:54:40.980602 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:40.981948 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b5ca3497-2963-4847-9ac0-f2816850bea5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Returning 404 to user: Instance 95a8e93a-cf62-4e41-98c8-a824827b2fda could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:54:40.981948 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b5ca3497-2963-4847-9ac0-f2816850bea5 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda" status: 404 len: 111 microversion: 2.1 time: 0.031322 Aug 31 11:54:40.981948 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 622/1228] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:40 2022] GET /compute/v2.1/servers/95a8e93a-cf62-4e41-98c8-a824827b2fda => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:54:40.986732 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d1e70b5c-d081-4b79-9760-0703edffa26a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:40.987247 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d1e70b5c-d081-4b79-9760-0703edffa26a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:40.993341 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d1e70b5c-d081-4b79-9760-0703edffa26a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:40.993806 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d1e70b5c-d081-4b79-9760-0703edffa26a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:40.994225 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d1e70b5c-d081-4b79-9760-0703edffa26a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:40.994921 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d1e70b5c-d081-4b79-9760-0703edffa26a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:40.995358 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d1e70b5c-d081-4b79-9760-0703edffa26a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:40.995770 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d1e70b5c-d081-4b79-9760-0703edffa26a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:41.008786 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b3f5f20f-bf6b-437e-b40b-08eff4a031da tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:41.009396 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b3f5f20f-bf6b-437e-b40b-08eff4a031da tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:41.010727 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-d1e70b5c-d081-4b79-9760-0703edffa26a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] HTTP exception thrown: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d1e70b5c-d081-4b79-9760-0703edffa26a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Request method failure captured: Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: DELETE /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be HTTP/1.1 Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lNZK36WRJOqsZNJl20dtBROIhvCChjxxXw9hostbElDCeoQYmhRnMS-kPydTDnhED92nvTRK2Z-mbhSicQnNG72V_XHtUyBJEP0Dy5LBQs28qt-qUXpO9451h3L1SwnxBkofz4240mv6LO2saJFZwry8omihvYKRxBlQ5VwAkEiuA Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:54:41.012243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:54:41.013868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4ac4dc41f7e420d811483990e020f22", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}] Aug 31 11:54:41.013868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:41.013868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:41.013868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:41.013868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:41.013868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:54:41.013868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:54:41.013868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 5de832888ffd4a69ae88cac6b632304e Aug 31 11:54:41.013868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:41.013868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:54:41.013868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. Aug 31 11:54:41.013868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '89973a85-9500-443c-b017-ceeb73cfc3be'} Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:54:41.014716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. Aug 31 11:54:41.016179 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.018048 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d1e70b5c-d081-4b79-9760-0703edffa26a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Returning 404 to user: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:54:41.018048 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d1e70b5c-d081-4b79-9760-0703edffa26a tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "DELETE /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 404 len: 111 microversion: 2.1 time: 0.030715 Aug 31 11:54:41.018048 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 607/1229] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:54:40 2022] DELETE /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:54:41.018414 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3f5f20f-bf6b-437e-b40b-08eff4a031da tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:41.018728 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3f5f20f-bf6b-437e-b40b-08eff4a031da tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:41.019167 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3f5f20f-bf6b-437e-b40b-08eff4a031da tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:41.019860 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3f5f20f-bf6b-437e-b40b-08eff4a031da tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:41.020315 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3f5f20f-bf6b-437e-b40b-08eff4a031da tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:41.020778 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b3f5f20f-bf6b-437e-b40b-08eff4a031da tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:41.021417 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d06f68d9-fcae-4190-9011-6956088b1b5b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:41.022014 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-d06f68d9-fcae-4190-9011-6956088b1b5b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: 89973a85-9500-443c-b017-ceeb73cfc3be] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:41.028254 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d06f68d9-fcae-4190-9011-6956088b1b5b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:41.028771 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d06f68d9-fcae-4190-9011-6956088b1b5b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:41.029200 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d06f68d9-fcae-4190-9011-6956088b1b5b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:41.029875 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d06f68d9-fcae-4190-9011-6956088b1b5b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:41.030317 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d06f68d9-fcae-4190-9011-6956088b1b5b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:41.030734 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-d06f68d9-fcae-4190-9011-6956088b1b5b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:41.044849 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-d06f68d9-fcae-4190-9011-6956088b1b5b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] HTTP exception thrown: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d06f68d9-fcae-4190-9011-6956088b1b5b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Request method failure captured: Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be HTTP/1.1 Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lNZK36WRJOqsZNJl20dtBROIhvCChjxxXw9hostbElDCeoQYmhRnMS-kPydTDnhED92nvTRK2Z-mbhSicQnNG72V_XHtUyBJEP0Dy5LBQs28qt-qUXpO9451h3L1SwnxBkofz4240mv6LO2saJFZwry8omihvYKRxBlQ5VwAkEiuA Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:54:41.048510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:54:41.052284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4ac4dc41f7e420d811483990e020f22", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}] Aug 31 11:54:41.052284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:41.052284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:41.052284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:41.052284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:41.052284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:54:41.052284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:54:41.052284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 5de832888ffd4a69ae88cac6b632304e Aug 31 11:54:41.052284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:41.052284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:54:41.052284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. Aug 31 11:54:41.052284 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '89973a85-9500-443c-b017-ceeb73cfc3be'} Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:54:41.053817 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. Aug 31 11:54:41.056510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.058839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-d06f68d9-fcae-4190-9011-6956088b1b5b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Returning 404 to user: Instance 89973a85-9500-443c-b017-ceeb73cfc3be could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:54:41.058839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-d06f68d9-fcae-4190-9011-6956088b1b5b tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be" status: 404 len: 111 microversion: 2.1 time: 0.030130 Aug 31 11:54:41.058839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 608/1230] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:41 2022] GET /compute/v2.1/servers/89973a85-9500-443c-b017-ceeb73cfc3be => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:54:41.154878 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-64c44d64-b696-4332-b3b1-81cdc91363f4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:41.155533 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-64c44d64-b696-4332-b3b1-81cdc91363f4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:41.168263 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-64c44d64-b696-4332-b3b1-81cdc91363f4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:41.168792 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-64c44d64-b696-4332-b3b1-81cdc91363f4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:41.169314 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-64c44d64-b696-4332-b3b1-81cdc91363f4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:41.170064 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-64c44d64-b696-4332-b3b1-81cdc91363f4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:41.170511 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-64c44d64-b696-4332-b3b1-81cdc91363f4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:41.171114 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-64c44d64-b696-4332-b3b1-81cdc91363f4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:41.174108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b3f5f20f-bf6b-437e-b40b-08eff4a031da tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:41.187479 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b3f5f20f-bf6b-437e-b40b-08eff4a031da tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1261 microversion: 2.1 time: 0.182349 Aug 31 11:54:41.193956 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 623/1231] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:41 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:54:41.203188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-64c44d64-b696-4332-b3b1-81cdc91363f4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] HTTP exception thrown: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-64c44d64-b696-4332-b3b1-81cdc91363f4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Request method failure captured: Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: DELETE /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e HTTP/1.1 Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0lJpcTrn2pLuUpyWlfyBmJ8Vt5JJ3uQ9jN10mg0OVovMDnoYwXIZjXocsPXhMukVZty2BNiMkG0ANSlP-GAoSzVorz2e1TgtDzD_qYmy-Suxl3bSzErwIE2aUzE2pM9oyHzJ8M5qSQa0NIp5D2BabPWHbiCz8IFK2W7BE_NlZj6M7o Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: 23acf169856c41d888a1d4c0e61cfee2 Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:54:41.205137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:54:41.206631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_23acf169856c41d888a1d4c0e61cfee2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/23acf169856c41d888a1d4c0e61cfee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23acf169856c41d888a1d4c0e61cfee2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23acf169856c41d888a1d4c0e61cfee2"}]}] Aug 31 11:54:41.206631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:54:41.206631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: 23acf169856c41d888a1d4c0e61cfee2 Aug 31 11:54:41.206631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:54:41.206631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-AttachVolumeShelveTestJSON-910663346-project Aug 31 11:54:41.206631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:54:41.206631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:54:41.206631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: bcd4602a40964a81931cdadc92d7f281 Aug 31 11:54:41.206631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-AttachVolumeShelveTestJSON-910663346-project Aug 31 11:54:41.206631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:54:41.206631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. Aug 31 11:54:41.206631 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '06215e54-27bb-4685-9a34-14109d73c81e'} Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:54:41.207404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. Aug 31 11:54:41.209261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.212046 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-64c44d64-b696-4332-b3b1-81cdc91363f4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Returning 404 to user: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:54:41.212046 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-64c44d64-b696-4332-b3b1-81cdc91363f4 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "DELETE /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 404 len: 111 microversion: 2.20 time: 0.066484 Aug 31 11:54:41.212046 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 609/1232] 10.222.0.60 () {60 vars in 1280 bytes} [Wed Aug 31 11:54:41 2022] DELETE /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:54:41.220128 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a145cb88-f0b0-49c2-8ec5-de3a77c59616 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:41.220805 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a145cb88-f0b0-49c2-8ec5-de3a77c59616 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] [instance: 06215e54-27bb-4685-9a34-14109d73c81e] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:41.227181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a145cb88-f0b0-49c2-8ec5-de3a77c59616 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:41.227672 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a145cb88-f0b0-49c2-8ec5-de3a77c59616 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:41.228111 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a145cb88-f0b0-49c2-8ec5-de3a77c59616 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:41.228907 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a145cb88-f0b0-49c2-8ec5-de3a77c59616 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:41.229509 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a145cb88-f0b0-49c2-8ec5-de3a77c59616 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:41.229771 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a145cb88-f0b0-49c2-8ec5-de3a77c59616 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:41.244153 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-a145cb88-f0b0-49c2-8ec5-de3a77c59616 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] HTTP exception thrown: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a145cb88-f0b0-49c2-8ec5-de3a77c59616 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Request method failure captured: Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e HTTP/1.1 Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lJpcTrn2pLuUpyWlfyBmJ8Vt5JJ3uQ9jN10mg0OVovMDnoYwXIZjXocsPXhMukVZty2BNiMkG0ANSlP-GAoSzVorz2e1TgtDzD_qYmy-Suxl3bSzErwIE2aUzE2pM9oyHzJ8M5qSQa0NIp5D2BabPWHbiCz8IFK2W7BE_NlZj6M7o Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 23acf169856c41d888a1d4c0e61cfee2 Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:54:41.245681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:54:41.247435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_23acf169856c41d888a1d4c0e61cfee2", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/23acf169856c41d888a1d4c0e61cfee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23acf169856c41d888a1d4c0e61cfee2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/23acf169856c41d888a1d4c0e61cfee2"}]}] Aug 31 11:54:41.247435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:54:41.247435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 23acf169856c41d888a1d4c0e61cfee2 Aug 31 11:54:41.247435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-910663346 Aug 31 11:54:41.247435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-AttachVolumeShelveTestJSON-910663346-project Aug 31 11:54:41.247435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:54:41.247435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:54:41.247435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: bcd4602a40964a81931cdadc92d7f281 Aug 31 11:54:41.247435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-AttachVolumeShelveTestJSON-910663346-project Aug 31 11:54:41.247435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:54:41.247435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. Aug 31 11:54:41.247435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': '06215e54-27bb-4685-9a34-14109d73c81e'} Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:54:41.248233 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. Aug 31 11:54:41.249651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:41.251156 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a145cb88-f0b0-49c2-8ec5-de3a77c59616 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] Returning 404 to user: Instance 06215e54-27bb-4685-9a34-14109d73c81e could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:54:41.251156 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a145cb88-f0b0-49c2-8ec5-de3a77c59616 tempest-AttachVolumeShelveTestJSON-910663346 tempest-AttachVolumeShelveTestJSON-910663346-project] 10.222.0.60 "GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e" status: 404 len: 111 microversion: 2.20 time: 0.030798 Aug 31 11:54:41.251502 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 624/1233] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Aug 31 11:54:41 2022] GET /compute/v2.1/servers/06215e54-27bb-4685-9a34-14109d73c81e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:54:42.216413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a6241edd-257a-4c85-9ddd-36da6caf5273 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:42.218024 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a6241edd-257a-4c85-9ddd-36da6caf5273 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:42.224970 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a6241edd-257a-4c85-9ddd-36da6caf5273 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:42.225454 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a6241edd-257a-4c85-9ddd-36da6caf5273 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:42.225879 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a6241edd-257a-4c85-9ddd-36da6caf5273 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:42.226615 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a6241edd-257a-4c85-9ddd-36da6caf5273 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:42.227128 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a6241edd-257a-4c85-9ddd-36da6caf5273 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:42.227555 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a6241edd-257a-4c85-9ddd-36da6caf5273 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:42.250210 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3ec64d21-7a7f-427c-b970-621bf1a24fc3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:42.251412 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3ec64d21-7a7f-427c-b970-621bf1a24fc3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:42.259185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3ec64d21-7a7f-427c-b970-621bf1a24fc3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:42.260024 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3ec64d21-7a7f-427c-b970-621bf1a24fc3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:42.260719 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3ec64d21-7a7f-427c-b970-621bf1a24fc3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:42.261669 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3ec64d21-7a7f-427c-b970-621bf1a24fc3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:42.262346 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3ec64d21-7a7f-427c-b970-621bf1a24fc3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:42.262986 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3ec64d21-7a7f-427c-b970-621bf1a24fc3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:42.278562 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-3ec64d21-7a7f-427c-b970-621bf1a24fc3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] HTTP exception thrown: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3ec64d21-7a7f-427c-b970-621bf1a24fc3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Request method failure captured: Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: DELETE /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 HTTP/1.1 Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lNZK36WRJOqsZNJl20dtBROIhvCChjxxXw9hostbElDCeoQYmhRnMS-kPydTDnhED92nvTRK2Z-mbhSicQnNG72V_XHtUyBJEP0Dy5LBQs28qt-qUXpO9451h3L1SwnxBkofz4240mv6LO2saJFZwry8omihvYKRxBlQ5VwAkEiuA Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:54:42.280123 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:54:42.281790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4ac4dc41f7e420d811483990e020f22", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}] Aug 31 11:54:42.281790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:42.281790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:42.281790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:42.281790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:42.281790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:54:42.281790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:54:42.281790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 5de832888ffd4a69ae88cac6b632304e Aug 31 11:54:42.281790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:42.281790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:54:42.281790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. Aug 31 11:54:42.281790 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': 'ece59cd5-8579-4406-be68-9d0204aeb446'} Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:54:42.282817 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. Aug 31 11:54:42.284308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:42.286876 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3ec64d21-7a7f-427c-b970-621bf1a24fc3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Returning 404 to user: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:54:42.287720 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3ec64d21-7a7f-427c-b970-621bf1a24fc3 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 404 len: 111 microversion: 2.1 time: 0.042154 Aug 31 11:54:42.288319 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 625/1234] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:54:42 2022] DELETE /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:54:42.297507 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b7728216-6d07-4e11-88d9-dc3a35b6b396 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:42.298146 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b7728216-6d07-4e11-88d9-dc3a35b6b396 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] [instance: ece59cd5-8579-4406-be68-9d0204aeb446] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:42.304175 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b7728216-6d07-4e11-88d9-dc3a35b6b396 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:42.304710 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b7728216-6d07-4e11-88d9-dc3a35b6b396 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:42.305423 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b7728216-6d07-4e11-88d9-dc3a35b6b396 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:42.306121 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b7728216-6d07-4e11-88d9-dc3a35b6b396 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:42.306595 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b7728216-6d07-4e11-88d9-dc3a35b6b396 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:42.307016 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b7728216-6d07-4e11-88d9-dc3a35b6b396 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:42.323647 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-b7728216-6d07-4e11-88d9-dc3a35b6b396 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] HTTP exception thrown: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b7728216-6d07-4e11-88d9-dc3a35b6b396 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Request method failure captured: Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 HTTP/1.1 Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0lNZK36WRJOqsZNJl20dtBROIhvCChjxxXw9hostbElDCeoQYmhRnMS-kPydTDnhED92nvTRK2Z-mbhSicQnNG72V_XHtUyBJEP0Dy5LBQs28qt-qUXpO9451h3L1SwnxBkofz4240mv6LO2saJFZwry8omihvYKRxBlQ5VwAkEiuA Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:54:42.325204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:54:42.326645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b4ac4dc41f7e420d811483990e020f22", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b4ac4dc41f7e420d811483990e020f22"}]}] Aug 31 11:54:42.326645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:42.326645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: b4ac4dc41f7e420d811483990e020f22 Aug 31 11:54:42.326645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2121462073 Aug 31 11:54:42.326645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:42.326645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:54:42.326645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:54:42.326645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 5de832888ffd4a69ae88cac6b632304e Aug 31 11:54:42.326645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-AttachVolumeNegativeTest-2121462073-project Aug 31 11:54:42.326645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:54:42.326645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. Aug 31 11:54:42.326645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': 'ece59cd5-8579-4406-be68-9d0204aeb446'} Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:54:42.328011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. Aug 31 11:54:42.331448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:42.333525 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b7728216-6d07-4e11-88d9-dc3a35b6b396 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] Returning 404 to user: Instance ece59cd5-8579-4406-be68-9d0204aeb446 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:54:42.333525 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b7728216-6d07-4e11-88d9-dc3a35b6b396 tempest-AttachVolumeNegativeTest-2121462073 tempest-AttachVolumeNegativeTest-2121462073-project] 10.222.0.60 "GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446" status: 404 len: 111 microversion: 2.1 time: 0.033801 Aug 31 11:54:42.333525 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 626/1235] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:42 2022] GET /compute/v2.1/servers/ece59cd5-8579-4406-be68-9d0204aeb446 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:54:42.422545 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a6241edd-257a-4c85-9ddd-36da6caf5273 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:42.434988 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a6241edd-257a-4c85-9ddd-36da6caf5273 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1261 microversion: 2.1 time: 0.224049 Aug 31 11:54:42.437709 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 610/1236] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:42 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1261 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:43.463050 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cec5d86a-84b0-4a7a-8b58-cd55d6fff5f6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:43.463680 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cec5d86a-84b0-4a7a-8b58-cd55d6fff5f6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:43.470449 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cec5d86a-84b0-4a7a-8b58-cd55d6fff5f6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:43.471387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cec5d86a-84b0-4a7a-8b58-cd55d6fff5f6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:43.472175 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cec5d86a-84b0-4a7a-8b58-cd55d6fff5f6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:43.473064 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cec5d86a-84b0-4a7a-8b58-cd55d6fff5f6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:43.473690 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cec5d86a-84b0-4a7a-8b58-cd55d6fff5f6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:43.474285 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cec5d86a-84b0-4a7a-8b58-cd55d6fff5f6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:43.829900 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cec5d86a-84b0-4a7a-8b58-cd55d6fff5f6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:43.843527 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cec5d86a-84b0-4a7a-8b58-cd55d6fff5f6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1261 microversion: 2.1 time: 0.385748 Aug 31 11:54:43.844554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 627/1237] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:43 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1261 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:44.549183 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-b648c081-586f-42b6-a5fe-341d39319da6 req-d3496c8e-2f9c-4819-8f07-f3eaa4425e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae99bf4-5a13-4a75-9b1d-74322674eef7", "name": "network-vif-plugged", "status": "completed", "tag": "ae42fa42-e307-48c8-84d2-bb9169f0531f"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:54:44.573776 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-b648c081-586f-42b6-a5fe-341d39319da6 req-d3496c8e-2f9c-4819-8f07-f3eaa4425e80 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:44.574577 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-b648c081-586f-42b6-a5fe-341d39319da6 req-d3496c8e-2f9c-4819-8f07-f3eaa4425e80 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:44.575170 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-b648c081-586f-42b6-a5fe-341d39319da6 req-d3496c8e-2f9c-4819-8f07-f3eaa4425e80 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:44.588955 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-b648c081-586f-42b6-a5fe-341d39319da6 req-d3496c8e-2f9c-4819-8f07-f3eaa4425e80 service nova] Creating event network-vif-plugged:ae42fa42-e307-48c8-84d2-bb9169f0531f for instance cae99bf4-5a13-4a75-9b1d-74322674eef7 on hv-cinder-83976 Aug 31 11:54:44.596289 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-b648c081-586f-42b6-a5fe-341d39319da6 req-d3496c8e-2f9c-4819-8f07-f3eaa4425e80 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051022 Aug 31 11:54:44.603415 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 611/1238] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:44.866495 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a64ea69a-4db0-481d-8bcf-41133bb3223c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:44.868213 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a64ea69a-4db0-481d-8bcf-41133bb3223c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:44.884695 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a64ea69a-4db0-481d-8bcf-41133bb3223c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:44.885449 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a64ea69a-4db0-481d-8bcf-41133bb3223c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:44.885742 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a64ea69a-4db0-481d-8bcf-41133bb3223c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:44.886503 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a64ea69a-4db0-481d-8bcf-41133bb3223c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:44.886951 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a64ea69a-4db0-481d-8bcf-41133bb3223c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:44.887374 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a64ea69a-4db0-481d-8bcf-41133bb3223c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:45.243149 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a64ea69a-4db0-481d-8bcf-41133bb3223c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:45.258017 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a64ea69a-4db0-481d-8bcf-41133bb3223c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1261 microversion: 2.1 time: 0.395503 Aug 31 11:54:45.259351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 628/1239] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:44 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1261 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:46.281366 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-a9664591-66de-436a-b62b-1a2b2f4301b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:46.281883 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-a9664591-66de-436a-b62b-1a2b2f4301b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:46.297824 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a9664591-66de-436a-b62b-1a2b2f4301b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:46.298442 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a9664591-66de-436a-b62b-1a2b2f4301b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:46.299065 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a9664591-66de-436a-b62b-1a2b2f4301b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:46.299856 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a9664591-66de-436a-b62b-1a2b2f4301b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:46.300389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a9664591-66de-436a-b62b-1a2b2f4301b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:46.300908 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-a9664591-66de-436a-b62b-1a2b2f4301b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:46.636966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-a9664591-66de-436a-b62b-1a2b2f4301b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:46.652048 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-a9664591-66de-436a-b62b-1a2b2f4301b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1445 microversion: 2.1 time: 0.376144 Aug 31 11:54:46.660460 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 612/1240] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:46 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1445 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:46.672854 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8e46dec1-770e-44d2-a994-00d8455fcba5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:46.675029 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8e46dec1-770e-44d2-a994-00d8455fcba5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:54:46.680508 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e46dec1-770e-44d2-a994-00d8455fcba5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:46.681120 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e46dec1-770e-44d2-a994-00d8455fcba5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:46.682018 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e46dec1-770e-44d2-a994-00d8455fcba5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:46.682337 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e46dec1-770e-44d2-a994-00d8455fcba5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:46.682857 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e46dec1-770e-44d2-a994-00d8455fcba5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:46.683484 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8e46dec1-770e-44d2-a994-00d8455fcba5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:46.927769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8e46dec1-770e-44d2-a994-00d8455fcba5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:54:46.953923 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8e46dec1-770e-44d2-a994-00d8455fcba5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1445 microversion: 2.1 time: 0.284503 Aug 31 11:54:46.965052 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 629/1241] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:54:46 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1445 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:54:47.861634 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bf1f84ce-37f9-44ca-b12e-28de252aba94 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Action: 'create', calling method: .version_select at 0x7f173805f700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1184506689"}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:54:48.360671 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-bf1f84ce-37f9-44ca-b12e-28de252aba94 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.720513 Aug 31 11:54:48.361744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 613/1242] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Aug 31 11:54:47 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 723 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 11:54:48.382679 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-11e69e93-292b-4838-a94e-dc10f8eb5f31 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1734b729d0>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:48.459521 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-11e69e93-292b-4838-a94e-dc10f8eb5f31 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d" status: 200 len: 345 microversion: 2.1 time: 0.088370 Aug 31 11:54:48.465902 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 630/1243] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:54:48 2022] GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d => generated 345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:54:49.475233 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-c3272044-9b74-4136-967f-a6f9120bf1ef tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1734ad4790>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:49.557075 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-c3272044-9b74-4136-967f-a6f9120bf1ef tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d" status: 200 len: 346 microversion: 2.1 time: 0.086624 Aug 31 11:54:49.557919 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 614/1244] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:54:49 2022] GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d => generated 346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:49.571645 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b28143fa-f172-4827-9e65-21a1a2ab1705 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Action: 'create', calling method: .version_select at 0x7f17349df700>, body: {"snapshot": {"volume_id": "02c6a439-2cd7-47a2-bd39-5e351d28e57d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1816071046"}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:54:49.606839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-0400edca-aacd-4655-a0e1-5e06ec73c251 req-6ca409d5-a251-41a0-92c5-55567ca5faef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae99bf4-5a13-4a75-9b1d-74322674eef7", "tag": "ae42fa42-e307-48c8-84d2-bb9169f0531f"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:54:49.611784 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:54:49.626148 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-0400edca-aacd-4655-a0e1-5e06ec73c251 req-6ca409d5-a251-41a0-92c5-55567ca5faef service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:54:49.627651 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-0400edca-aacd-4655-a0e1-5e06ec73c251 req-6ca409d5-a251-41a0-92c5-55567ca5faef service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:54:49.628790 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-0400edca-aacd-4655-a0e1-5e06ec73c251 req-6ca409d5-a251-41a0-92c5-55567ca5faef service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:54:49.642318 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-0400edca-aacd-4655-a0e1-5e06ec73c251 req-6ca409d5-a251-41a0-92c5-55567ca5faef service nova] Creating event network-changed:ae42fa42-e307-48c8-84d2-bb9169f0531f for instance cae99bf4-5a13-4a75-9b1d-74322674eef7 on hv-cinder-83976 Aug 31 11:54:49.648153 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-0400edca-aacd-4655-a0e1-5e06ec73c251 req-6ca409d5-a251-41a0-92c5-55567ca5faef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044847 Aug 31 11:54:49.649361 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 615/1245] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:54:49.816609 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b28143fa-f172-4827-9e65-21a1a2ab1705 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.249591 Aug 31 11:54:49.819414 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 631/1246] 10.222.0.60 () {60 vars in 1162 bytes} [Wed Aug 31 11:54:49 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:49.833229 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2437d21e-7a67-4ad8-aa87-9db4eae2dc7a tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1738168820>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:49.875653 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2437d21e-7a67-4ad8-aa87-9db4eae2dc7a tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec" status: 200 len: 287 microversion: 2.1 time: 0.048744 Aug 31 11:54:49.876289 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 616/1247] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 31 11:54:49 2022] GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:49.887884 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f64e3205-0b10-47e8-af90-1109d9147fcc tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1734a451f0>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:49.932007 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f64e3205-0b10-47e8-af90-1109d9147fcc tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.047969 Aug 31 11:54:49.938514 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 632/1248] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Aug 31 11:54:49 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:54:49.944002 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-cf6aaa1d-1080-49b2-b767-e87571758a6f tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1738289700>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:49.979260 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-cf6aaa1d-1080-49b2-b767-e87571758a6f tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec" status: 200 len: 287 microversion: 2.1 time: 0.039323 Aug 31 11:54:49.980151 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 617/1249] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 31 11:54:49 2022] GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:50.993379 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-641360df-7646-4d0d-bef6-841fffb7847e tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1734bf7af0>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:51.023850 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-641360df-7646-4d0d-bef6-841fffb7847e tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec" status: 200 len: 287 microversion: 2.1 time: 0.036049 Aug 31 11:54:51.024469 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 633/1250] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 31 11:54:50 2022] GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:52.037311 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-54de60f3-39a4-4114-8c7d-b74d690a9884 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1734af9700>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:52.069078 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-54de60f3-39a4-4114-8c7d-b74d690a9884 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec" status: 200 len: 287 microversion: 2.1 time: 0.036209 Aug 31 11:54:52.069770 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 618/1251] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 31 11:54:52 2022] GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:53.083224 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ff20d7a7-ff8c-4995-977f-379925f19e7e tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f173477e820>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:53.112927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ff20d7a7-ff8c-4995-977f-379925f19e7e tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec" status: 200 len: 287 microversion: 2.1 time: 0.033900 Aug 31 11:54:53.113489 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 634/1252] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 31 11:54:53 2022] GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:54.126621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e29b3460-9015-4d19-b0ee-691fca86378f tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1734b44af0>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:54.158323 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e29b3460-9015-4d19-b0ee-691fca86378f tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec" status: 200 len: 287 microversion: 2.1 time: 0.035868 Aug 31 11:54:54.158886 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 619/1253] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 31 11:54:54 2022] GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:55.171756 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-320e7e2a-a929-445d-b96a-b1fecf5c4020 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1734bf7ca0>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:55.202286 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-320e7e2a-a929-445d-b96a-b1fecf5c4020 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec" status: 200 len: 287 microversion: 2.1 time: 0.034902 Aug 31 11:54:55.202936 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 635/1254] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 31 11:54:55 2022] GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:56.216101 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ef474d67-1eb5-474c-86ce-f714bbeb7ed3 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f173821cca0>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:56.246475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ef474d67-1eb5-474c-86ce-f714bbeb7ed3 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec" status: 200 len: 288 microversion: 2.1 time: 0.034825 Aug 31 11:54:56.247347 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 620/1255] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 31 11:54:56 2022] GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:56.258844 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cd8c56be-596b-4849-981e-aa48c3ecf2a1 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1734b72700>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:56.323514 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cd8c56be-596b-4849-981e-aa48c3ecf2a1 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec" status: 202 len: 0 microversion: 2.1 time: 0.069261 Aug 31 11:54:56.324083 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 636/1256] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Aug 31 11:54:56 2022] DELETE /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:54:56.332328 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-7dd7dce8-e6fb-45de-9384-609888fcd9ac tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1738289700>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:56.362666 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-7dd7dce8-e6fb-45de-9384-609888fcd9ac tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec" status: 200 len: 287 microversion: 2.1 time: 0.034144 Aug 31 11:54:56.363228 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 621/1257] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 31 11:54:56 2022] GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:57.371819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:54:57.372666 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=36 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:54:57.377909 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-aacb68be-bb4a-4cf7-80e2-58f097812724 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1734cfdee0>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:57.404259 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-aacb68be-bb4a-4cf7-80e2-58f097812724 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] HTTP exception thrown: Snapshot d62976b0-66c6-4c2a-8b03-16457ef0e3ec could not be found. Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-aacb68be-bb4a-4cf7-80e2-58f097812724 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Request method failure captured: Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec HTTP/1.1 Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0wHPV62KN3gHmHQmxsJaUo0z7j9gVpc-3g9ZE8fbtPOOKZisWUEQJOMNvk8FxTwcVSykAwR_5NgMPd7qAG9FrXckLNxQ5r_D-I6dfLr_PcXj_FcY6hWoMKnmiGyh2HNDYrh0DIzh70X9s4Y0q0ddcL7KUyyUvpAzxsZDEyzJ1VE3Aw Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 9146a0d909254dfd9fba5fd8f3883ad4 Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-245815664 Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:54:57.406663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:54:57.408661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9146a0d909254dfd9fba5fd8f3883ad4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9146a0d909254dfd9fba5fd8f3883ad4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9146a0d909254dfd9fba5fd8f3883ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9146a0d909254dfd9fba5fd8f3883ad4"}]}] Aug 31 11:54:57.408661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-VolumesSnapshotsTestJSON-245815664 Aug 31 11:54:57.408661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 9146a0d909254dfd9fba5fd8f3883ad4 Aug 31 11:54:57.408661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-245815664 Aug 31 11:54:57.408661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-VolumesSnapshotsTestJSON-245815664-project Aug 31 11:54:57.408661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:54:57.408661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:54:57.408661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 1013fab844d841d1bba713a69a05ec1b Aug 31 11:54:57.408661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-VolumesSnapshotsTestJSON-245815664-project Aug 31 11:54:57.408661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: Aug 31 11:54:57.408661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Snapshot d62976b0-66c6-4c2a-8b03-16457ef0e3ec could not be found. Aug 31 11:54:57.408661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': 'd62976b0-66c6-4c2a-8b03-16457ef0e3ec'} Aug 31 11:54:57.408661 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d62976b0-66c6-4c2a-8b03-16457ef0e3ec could not be found. (HTTP 404) (Request-ID: req-02e02bc9-a47e-4712-ac03-db48edc094b4) Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:57.414554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:54:57.415971 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d62976b0-66c6-4c2a-8b03-16457ef0e3ec could not be found. Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 11:54:57.417387 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:54:57.418894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d62976b0-66c6-4c2a-8b03-16457ef0e3ec could not be found. Aug 31 11:54:57.418894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:57.418894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:54:57.418894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:57.418894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:54:57.418894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:54:57.418894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:54:57.418894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:54:57.418894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:54:57.418894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d62976b0-66c6-4c2a-8b03-16457ef0e3ec could not be found. Aug 31 11:54:57.418894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:54:57.418894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-aacb68be-bb4a-4cf7-80e2-58f097812724 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Returning 404 to user: Snapshot d62976b0-66c6-4c2a-8b03-16457ef0e3ec could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:54:57.418894 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-aacb68be-bb4a-4cf7-80e2-58f097812724 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec" status: 404 len: 111 microversion: 2.1 time: 0.037229 Aug 31 11:54:57.419912 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 637/1258] 10.222.0.60 () {58 vars in 1251 bytes} [Wed Aug 31 11:54:57 2022] GET /compute/v2.1/os-snapshots/d62976b0-66c6-4c2a-8b03-16457ef0e3ec => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:54:57.420004 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ed220664-7460-40b3-91db-6dcc236bd761 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1738075670>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:57.497014 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ed220664-7460-40b3-91db-6dcc236bd761 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d" status: 202 len: 0 microversion: 2.1 time: 0.078531 Aug 31 11:54:57.497014 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 622/1259] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 31 11:54:57 2022] DELETE /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:54:57.501753 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0cb676e4-5e82-455d-aa0d-e174b9656764 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f17349dd790>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:57.553219 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0cb676e4-5e82-455d-aa0d-e174b9656764 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d" status: 200 len: 345 microversion: 2.1 time: 0.055278 Aug 31 11:54:57.553830 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 638/1260] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:54:57 2022] GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:58.568067 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-783295ab-4bce-4e7b-b769-ffc7e794fbe0 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f17381e9e50>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:58.617077 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-783295ab-4bce-4e7b-b769-ffc7e794fbe0 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d" status: 200 len: 345 microversion: 2.1 time: 0.053505 Aug 31 11:54:58.617892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 623/1261] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:54:58 2022] GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:54:59.630435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0a31c925-bc8a-428f-b823-12159c63a7d7 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f173477e280>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:54:59.683976 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0a31c925-bc8a-428f-b823-12159c63a7d7 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d" status: 200 len: 345 microversion: 2.1 time: 0.053346 Aug 31 11:54:59.685232 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 639/1262] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:54:59 2022] GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:55:00.696237 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=60 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:55:00.697012 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:55:00.701060 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f786be0d-2030-41af-acd6-4b48a871aefa tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1734b44f70>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:55:00.751228 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f786be0d-2030-41af-acd6-4b48a871aefa tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d" status: 200 len: 345 microversion: 2.1 time: 0.056692 Aug 31 11:55:00.751784 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 624/1263] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:55:00 2022] GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:55:01.765554 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-27686b45-d62c-4493-84e3-566dd784b86d tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1734b88430>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:55:01.814779 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-27686b45-d62c-4493-84e3-566dd784b86d tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d" status: 200 len: 345 microversion: 2.1 time: 0.054095 Aug 31 11:55:01.816865 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 640/1264] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:55:01 2022] GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:55:02.829361 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-94bf1af8-a6bb-45ea-831f-8f154bbbdde8 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f17381ae160>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:55:02.878515 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-94bf1af8-a6bb-45ea-831f-8f154bbbdde8 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d" status: 200 len: 345 microversion: 2.1 time: 0.053329 Aug 31 11:55:02.879089 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 625/1265] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:55:02 2022] GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:55:03.894677 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a36a163e-09d6-4e03-b832-83696f2983e7 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f17347610d0>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:55:03.924986 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-a36a163e-09d6-4e03-b832-83696f2983e7 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] HTTP exception thrown: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a36a163e-09d6-4e03-b832-83696f2983e7 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Request method failure captured: Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d HTTP/1.1 Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0wHPV62KN3gHmHQmxsJaUo0z7j9gVpc-3g9ZE8fbtPOOKZisWUEQJOMNvk8FxTwcVSykAwR_5NgMPd7qAG9FrXckLNxQ5r_D-I6dfLr_PcXj_FcY6hWoMKnmiGyh2HNDYrh0DIzh70X9s4Y0q0ddcL7KUyyUvpAzxsZDEyzJ1VE3Aw Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 9146a0d909254dfd9fba5fd8f3883ad4 Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-245815664 Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:55:03.928010 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:55:03.931681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9146a0d909254dfd9fba5fd8f3883ad4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9146a0d909254dfd9fba5fd8f3883ad4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9146a0d909254dfd9fba5fd8f3883ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9146a0d909254dfd9fba5fd8f3883ad4"}]}] Aug 31 11:55:03.931681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-VolumesSnapshotsTestJSON-245815664 Aug 31 11:55:03.931681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 9146a0d909254dfd9fba5fd8f3883ad4 Aug 31 11:55:03.931681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-245815664 Aug 31 11:55:03.931681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-VolumesSnapshotsTestJSON-245815664-project Aug 31 11:55:03.931681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:55:03.931681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:55:03.931681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 1013fab844d841d1bba713a69a05ec1b Aug 31 11:55:03.931681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-VolumesSnapshotsTestJSON-245815664-project Aug 31 11:55:03.931681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: Aug 31 11:55:03.931681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. Aug 31 11:55:03.931681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': '02c6a439-2cd7-47a2-bd39-5e351d28e57d'} Aug 31 11:55:03.931681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. (HTTP 404) (Request-ID: req-10e14c12-bce3-4578-b880-691e44a3a149) Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:03.933209 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:55:03.934430 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 11:55:03.935584 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:55:03.937272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. Aug 31 11:55:03.937272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:03.937272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:03.937272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:03.937272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:03.937272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:03.937272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:03.937272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:55:03.937272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:55:03.937272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. Aug 31 11:55:03.937272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:03.937272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a36a163e-09d6-4e03-b832-83696f2983e7 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Returning 404 to user: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:55:03.937272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a36a163e-09d6-4e03-b832-83696f2983e7 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d" status: 404 len: 109 microversion: 2.1 time: 0.041039 Aug 31 11:55:03.937272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 641/1266] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:55:03 2022] GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:55:03.941220 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e413b0d6-b647-4f26-b048-e474d723f3e0 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f1734ad4310>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:55:03.969584 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-e413b0d6-b647-4f26-b048-e474d723f3e0 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] HTTP exception thrown: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e413b0d6-b647-4f26-b048-e474d723f3e0 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Request method failure captured: Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: DELETE /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d HTTP/1.1 Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0wHPV62KN3gHmHQmxsJaUo0z7j9gVpc-3g9ZE8fbtPOOKZisWUEQJOMNvk8FxTwcVSykAwR_5NgMPd7qAG9FrXckLNxQ5r_D-I6dfLr_PcXj_FcY6hWoMKnmiGyh2HNDYrh0DIzh70X9s4Y0q0ddcL7KUyyUvpAzxsZDEyzJ1VE3Aw Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: 9146a0d909254dfd9fba5fd8f3883ad4 Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-245815664 Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:55:03.973007 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:55:03.974640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9146a0d909254dfd9fba5fd8f3883ad4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9146a0d909254dfd9fba5fd8f3883ad4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9146a0d909254dfd9fba5fd8f3883ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9146a0d909254dfd9fba5fd8f3883ad4"}]}] Aug 31 11:55:03.974640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-VolumesSnapshotsTestJSON-245815664 Aug 31 11:55:03.974640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: 9146a0d909254dfd9fba5fd8f3883ad4 Aug 31 11:55:03.974640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-245815664 Aug 31 11:55:03.974640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-VolumesSnapshotsTestJSON-245815664-project Aug 31 11:55:03.974640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:55:03.974640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:55:03.974640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: 1013fab844d841d1bba713a69a05ec1b Aug 31 11:55:03.974640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-VolumesSnapshotsTestJSON-245815664-project Aug 31 11:55:03.974640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: Aug 31 11:55:03.974640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. Aug 31 11:55:03.974640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '02c6a439-2cd7-47a2-bd39-5e351d28e57d'} Aug 31 11:55:03.974640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. (HTTP 404) (Request-ID: req-0735dce9-de44-40a2-a51a-cdff043495d1) Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:03.976163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:55:03.977862 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 11:55:03.982423 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:55:03.983901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. Aug 31 11:55:03.983901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:03.983901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:03.983901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:03.983901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:03.983901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:03.983901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:03.983901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:55:03.983901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:55:03.983901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. Aug 31 11:55:03.983901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:03.983901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e413b0d6-b647-4f26-b048-e474d723f3e0 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Returning 404 to user: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:55:03.983901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e413b0d6-b647-4f26-b048-e474d723f3e0 tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d" status: 404 len: 109 microversion: 2.1 time: 0.039812 Aug 31 11:55:03.983901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 626/1267] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 31 11:55:03 2022] DELETE /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:55:03.987011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-946dcb34-5ed8-40c6-819b-ac5dddafb1ce tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Calling method '.version_select at 0x7f17347c1a60>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:55:04.019678 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-946dcb34-5ed8-40c6-819b-ac5dddafb1ce tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] HTTP exception thrown: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-946dcb34-5ed8-40c6-819b-ac5dddafb1ce tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Request method failure captured: Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d HTTP/1.1 Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0wHPV62KN3gHmHQmxsJaUo0z7j9gVpc-3g9ZE8fbtPOOKZisWUEQJOMNvk8FxTwcVSykAwR_5NgMPd7qAG9FrXckLNxQ5r_D-I6dfLr_PcXj_FcY6hWoMKnmiGyh2HNDYrh0DIzh70X9s4Y0q0ddcL7KUyyUvpAzxsZDEyzJ1VE3Aw Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 9146a0d909254dfd9fba5fd8f3883ad4 Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-245815664 Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:55:04.021619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:55:04.023347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9146a0d909254dfd9fba5fd8f3883ad4", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9146a0d909254dfd9fba5fd8f3883ad4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9146a0d909254dfd9fba5fd8f3883ad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9146a0d909254dfd9fba5fd8f3883ad4"}]}] Aug 31 11:55:04.023347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-VolumesSnapshotsTestJSON-245815664 Aug 31 11:55:04.023347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 9146a0d909254dfd9fba5fd8f3883ad4 Aug 31 11:55:04.023347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-245815664 Aug 31 11:55:04.023347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-VolumesSnapshotsTestJSON-245815664-project Aug 31 11:55:04.023347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:55:04.023347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:55:04.023347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: 1013fab844d841d1bba713a69a05ec1b Aug 31 11:55:04.023347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-VolumesSnapshotsTestJSON-245815664-project Aug 31 11:55:04.023347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: Aug 31 11:55:04.023347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. Aug 31 11:55:04.023347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': '02c6a439-2cd7-47a2-bd39-5e351d28e57d'} Aug 31 11:55:04.023347 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. (HTTP 404) (Request-ID: req-6825932b-754b-45b1-9276-3d4b2cb74698) Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:04.027229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:55:04.028717 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 11:55:04.030185 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:55:04.031794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. Aug 31 11:55:04.031794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:04.031794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:04.031794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:04.031794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:04.031794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:04.031794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:04.031794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:55:04.031794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:55:04.031794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. Aug 31 11:55:04.031794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:04.031794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-946dcb34-5ed8-40c6-819b-ac5dddafb1ce tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] Returning 404 to user: Volume 02c6a439-2cd7-47a2-bd39-5e351d28e57d could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:55:04.031794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-946dcb34-5ed8-40c6-819b-ac5dddafb1ce tempest-VolumesSnapshotsTestJSON-245815664 tempest-VolumesSnapshotsTestJSON-245815664-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d" status: 404 len: 109 microversion: 2.1 time: 0.040562 Aug 31 11:55:04.031794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 642/1268] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:55:03 2022] GET /compute/v2.1/os-volumes/02c6a439-2cd7-47a2-bd39-5e351d28e57d => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:55:05.456092 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-00c15fbb-ba18-48fc-9f2a-232b926eabb6 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Action: 'create', calling method: .version_select at 0x7f1734ad4d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1844960055", "metadata": {"Type": "work"}}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-00c15fbb-ba18-48fc-9f2a-232b926eabb6 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Request method failure captured: Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 122 Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0wZGgizl0WC6m6zcfe22Z1wXN2p9PpEd8uN90bhOb6Hc02SPIQWAcZM7L_RxJLKzfUw4bxtHaI3mr1hiQkS7dwNZNkdgke7kBgmsr8PGVKK33-s-4AIIQlM09yXFNbifx3lUq7ewWRQKlsYEfkpoeRA8koBrb_121qBE86cYPOjLE4 Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: 7562d5717ca94c509dd7ac6aea987565 Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:55:05.475477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:55:05.477058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7562d5717ca94c509dd7ac6aea987565", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7562d5717ca94c509dd7ac6aea987565"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7562d5717ca94c509dd7ac6aea987565"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7562d5717ca94c509dd7ac6aea987565"}]}] Aug 31 11:55:05.477058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.477058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: 7562d5717ca94c509dd7ac6aea987565 Aug 31 11:55:05.477058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.477058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-VolumesNegativeTest-1016849367-project Aug 31 11:55:05.477058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:55:05.477058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:55:05.477058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: e55afbd435694ea0b9ea0d1a19a4abdb Aug 31 11:55:05.477058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-VolumesNegativeTest-1016849367-project Aug 31 11:55:05.477058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Aug 31 11:55:05.477058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1844960055", "metadata": {"Type": "work"}}} Aug 31 11:55:05.477058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: Aug 31 11:55:05.477058 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1844960055', 'metadata': {'Type': 'work'}}}} Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise error Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:55:05.477960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 11:55:05.479731 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 11:55:05.481205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 11:55:05.481205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.481205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-00c15fbb-ba18-48fc-9f2a-232b926eabb6 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:55:05.481205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-00c15fbb-ba18-48fc-9f2a-232b926eabb6 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.151686 Aug 31 11:55:05.481205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 627/1269] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Aug 31 11:55:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:55:05.488742 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5db15154-58c0-45a3-9910-d5ff1ae9f389 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Action: 'create', calling method: .version_select at 0x7f1734a07430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1444513280", "metadata": {"Type": "work"}}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5db15154-58c0-45a3-9910-d5ff1ae9f389 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Request method failure captured: Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 120 Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0wZGgizl0WC6m6zcfe22Z1wXN2p9PpEd8uN90bhOb6Hc02SPIQWAcZM7L_RxJLKzfUw4bxtHaI3mr1hiQkS7dwNZNkdgke7kBgmsr8PGVKK33-s-4AIIQlM09yXFNbifx3lUq7ewWRQKlsYEfkpoeRA8koBrb_121qBE86cYPOjLE4 Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 7562d5717ca94c509dd7ac6aea987565 Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:55:05.493919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:55:05.495535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7562d5717ca94c509dd7ac6aea987565", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7562d5717ca94c509dd7ac6aea987565"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7562d5717ca94c509dd7ac6aea987565"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7562d5717ca94c509dd7ac6aea987565"}]}] Aug 31 11:55:05.495535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.495535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 7562d5717ca94c509dd7ac6aea987565 Aug 31 11:55:05.495535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.495535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-VolumesNegativeTest-1016849367-project Aug 31 11:55:05.495535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:55:05.495535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:55:05.495535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: e55afbd435694ea0b9ea0d1a19a4abdb Aug 31 11:55:05.495535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-VolumesNegativeTest-1016849367-project Aug 31 11:55:05.495535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Aug 31 11:55:05.495535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1444513280", "metadata": {"Type": "work"}}} Aug 31 11:55:05.495535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: Aug 31 11:55:05.495535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1444513280', 'metadata': {'Type': 'work'}}}} Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise error Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi '0' Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:55:05.496439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 11:55:05.497875 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 11:55:05.499062 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 11:55:05.499062 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.499062 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5db15154-58c0-45a3-9910-d5ff1ae9f389 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:55:05.499062 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5db15154-58c0-45a3-9910-d5ff1ae9f389 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011790 Aug 31 11:55:05.499062 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 643/1270] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Aug 31 11:55:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:55:05.508749 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-42063411-ddac-42e1-815a-2737281f7bbf tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Action: 'create', calling method: .version_select at 0x7f17382893a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1359437106", "metadata": {"Type": "work"}}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-42063411-ddac-42e1-815a-2737281f7bbf tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Request method failure captured: Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 119 Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0wZGgizl0WC6m6zcfe22Z1wXN2p9PpEd8uN90bhOb6Hc02SPIQWAcZM7L_RxJLKzfUw4bxtHaI3mr1hiQkS7dwNZNkdgke7kBgmsr8PGVKK33-s-4AIIQlM09yXFNbifx3lUq7ewWRQKlsYEfkpoeRA8koBrb_121qBE86cYPOjLE4 Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: 7562d5717ca94c509dd7ac6aea987565 Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:55:05.512748 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:55:05.514966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7562d5717ca94c509dd7ac6aea987565", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7562d5717ca94c509dd7ac6aea987565"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7562d5717ca94c509dd7ac6aea987565"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7562d5717ca94c509dd7ac6aea987565"}]}] Aug 31 11:55:05.514966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.514966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: 7562d5717ca94c509dd7ac6aea987565 Aug 31 11:55:05.514966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.514966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-VolumesNegativeTest-1016849367-project Aug 31 11:55:05.514966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:55:05.514966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:55:05.514966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: e55afbd435694ea0b9ea0d1a19a4abdb Aug 31 11:55:05.514966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-VolumesNegativeTest-1016849367-project Aug 31 11:55:05.514966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Aug 31 11:55:05.514966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1359437106", "metadata": {"Type": "work"}}} Aug 31 11:55:05.514966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: Aug 31 11:55:05.514966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1359437106', 'metadata': {'Type': 'work'}}}} Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise error Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi '' Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:55:05.516100 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 11:55:05.518557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 11:55:05.520022 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 11:55:05.520022 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.520022 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-42063411-ddac-42e1-815a-2737281f7bbf tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:55:05.520022 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-42063411-ddac-42e1-815a-2737281f7bbf tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009308 Aug 31 11:55:05.520022 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 628/1271] 10.222.0.60 () {60 vars in 1156 bytes} [Wed Aug 31 11:55:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:55:05.526309 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-67e91b8a-4ac0-4763-9469-1382ca1621a1 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Calling method '.version_select at 0x7f1734867160>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:55:05.557491 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-67e91b8a-4ac0-4763-9469-1382ca1621a1 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] HTTP exception thrown: Volume tempest-invalid-1544683201 could not be found. Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-67e91b8a-4ac0-4763-9469-1382ca1621a1 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Request method failure captured: Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1544683201 HTTP/1.1 Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0wZGgizl0WC6m6zcfe22Z1wXN2p9PpEd8uN90bhOb6Hc02SPIQWAcZM7L_RxJLKzfUw4bxtHaI3mr1hiQkS7dwNZNkdgke7kBgmsr8PGVKK33-s-4AIIQlM09yXFNbifx3lUq7ewWRQKlsYEfkpoeRA8koBrb_121qBE86cYPOjLE4 Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 7562d5717ca94c509dd7ac6aea987565 Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:55:05.559476 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:55:05.560904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7562d5717ca94c509dd7ac6aea987565", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7562d5717ca94c509dd7ac6aea987565"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7562d5717ca94c509dd7ac6aea987565"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7562d5717ca94c509dd7ac6aea987565"}]}] Aug 31 11:55:05.560904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.560904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 7562d5717ca94c509dd7ac6aea987565 Aug 31 11:55:05.560904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.560904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-VolumesNegativeTest-1016849367-project Aug 31 11:55:05.560904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:55:05.560904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:55:05.560904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: e55afbd435694ea0b9ea0d1a19a4abdb Aug 31 11:55:05.560904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-VolumesNegativeTest-1016849367-project Aug 31 11:55:05.560904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: Aug 31 11:55:05.560904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Volume tempest-invalid-1544683201 could not be found. Aug 31 11:55:05.560904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': 'tempest-invalid-1544683201'} Aug 31 11:55:05.560904 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1544683201 could not be found. (HTTP 404) (Request-ID: req-5e1aed48-db15-4e4f-8c78-56f3b942cbf0) Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:05.561891 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:55:05.563433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1544683201 could not be found. Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:55:05.564821 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1544683201 could not be found. Aug 31 11:55:05.566563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.566563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:05.566563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.566563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.566563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:05.566563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:05.566563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:55:05.566563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:55:05.566563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1544683201 could not be found. Aug 31 11:55:05.566563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.566563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-67e91b8a-4ac0-4763-9469-1382ca1621a1 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Returning 404 to user: Volume tempest-invalid-1544683201 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:55:05.566563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-67e91b8a-4ac0-4763-9469-1382ca1621a1 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1544683201" status: 404 len: 99 microversion: 2.1 time: 0.039359 Aug 31 11:55:05.566563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 644/1272] 10.222.0.60 () {58 vars in 1218 bytes} [Wed Aug 31 11:55:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1544683201 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 11:55:05.572027 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-02fdd56e-44dd-40aa-8e4c-60f7a61b9c78 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005256 Aug 31 11:55:05.572459 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 629/1273] 10.222.0.60 () {58 vars in 1140 bytes} [Wed Aug 31 11:55:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 11:55:05.584354 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6e4e5ee8-ca0a-465c-adfe-5774ece8cc8e tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006735 Aug 31 11:55:05.584954 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 645/1274] 10.222.0.60 () {58 vars in 1137 bytes} [Wed Aug 31 11:55:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 11:55:05.594559 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4be4c31d-75e8-4be9-bce9-5d4cecb13af7 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Calling method '.version_select at 0x7f1738278820>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:55:05.633184 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-4be4c31d-75e8-4be9-bce9-5d4cecb13af7 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] HTTP exception thrown: Volume 1e435ff6-9a43-4214-8488-9f12f38b0c76 could not be found. Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4be4c31d-75e8-4be9-bce9-5d4cecb13af7 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Request method failure captured: Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: DELETE /compute/v2.1/os-volumes/1e435ff6-9a43-4214-8488-9f12f38b0c76 HTTP/1.1 Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0wZGgizl0WC6m6zcfe22Z1wXN2p9PpEd8uN90bhOb6Hc02SPIQWAcZM7L_RxJLKzfUw4bxtHaI3mr1hiQkS7dwNZNkdgke7kBgmsr8PGVKK33-s-4AIIQlM09yXFNbifx3lUq7ewWRQKlsYEfkpoeRA8koBrb_121qBE86cYPOjLE4 Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: 7562d5717ca94c509dd7ac6aea987565 Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:55:05.635113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:55:05.637540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7562d5717ca94c509dd7ac6aea987565", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7562d5717ca94c509dd7ac6aea987565"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7562d5717ca94c509dd7ac6aea987565"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7562d5717ca94c509dd7ac6aea987565"}]}] Aug 31 11:55:05.637540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.637540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: 7562d5717ca94c509dd7ac6aea987565 Aug 31 11:55:05.637540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.637540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-VolumesNegativeTest-1016849367-project Aug 31 11:55:05.637540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:55:05.637540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:55:05.637540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: e55afbd435694ea0b9ea0d1a19a4abdb Aug 31 11:55:05.637540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-VolumesNegativeTest-1016849367-project Aug 31 11:55:05.637540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: Aug 31 11:55:05.637540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Volume 1e435ff6-9a43-4214-8488-9f12f38b0c76 could not be found. Aug 31 11:55:05.637540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '1e435ff6-9a43-4214-8488-9f12f38b0c76'} Aug 31 11:55:05.637540 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e435ff6-9a43-4214-8488-9f12f38b0c76 could not be found. (HTTP 404) (Request-ID: req-1fc9295c-3163-4580-9f2f-c7022bba89f0) Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:05.640550 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:55:05.643521 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e435ff6-9a43-4214-8488-9f12f38b0c76 could not be found. Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 11:55:05.646621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:55:05.650589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e435ff6-9a43-4214-8488-9f12f38b0c76 could not be found. Aug 31 11:55:05.650589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.650589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:05.650589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.650589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.650589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:05.650589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:05.650589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:55:05.650589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:55:05.650589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e435ff6-9a43-4214-8488-9f12f38b0c76 could not be found. Aug 31 11:55:05.650589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.650589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4be4c31d-75e8-4be9-bce9-5d4cecb13af7 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Returning 404 to user: Volume 1e435ff6-9a43-4214-8488-9f12f38b0c76 could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:55:05.650589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4be4c31d-75e8-4be9-bce9-5d4cecb13af7 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/1e435ff6-9a43-4214-8488-9f12f38b0c76" status: 404 len: 109 microversion: 2.1 time: 0.045841 Aug 31 11:55:05.650589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 630/1275] 10.222.0.60 () {58 vars in 1248 bytes} [Wed Aug 31 11:55:05 2022] DELETE /compute/v2.1/os-volumes/1e435ff6-9a43-4214-8488-9f12f38b0c76 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:55:05.653677 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-19b2d09d-142b-4d10-923f-88a4c2bdb663 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Calling method '.version_select at 0x7f1734867e50>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:55:05.701000 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-19b2d09d-142b-4d10-923f-88a4c2bdb663 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] HTTP exception thrown: Volume 887cfd43-22b4-4155-b119-32be6cc51af8 could not be found. Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-19b2d09d-142b-4d10-923f-88a4c2bdb663 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Request method failure captured: Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/os-volumes/887cfd43-22b4-4155-b119-32be6cc51af8 HTTP/1.1 Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0wZGgizl0WC6m6zcfe22Z1wXN2p9PpEd8uN90bhOb6Hc02SPIQWAcZM7L_RxJLKzfUw4bxtHaI3mr1hiQkS7dwNZNkdgke7kBgmsr8PGVKK33-s-4AIIQlM09yXFNbifx3lUq7ewWRQKlsYEfkpoeRA8koBrb_121qBE86cYPOjLE4 Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 7562d5717ca94c509dd7ac6aea987565 Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:55:05.703188 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:55:05.705269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_7562d5717ca94c509dd7ac6aea987565", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/7562d5717ca94c509dd7ac6aea987565"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7562d5717ca94c509dd7ac6aea987565"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/7562d5717ca94c509dd7ac6aea987565"}]}] Aug 31 11:55:05.705269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.705269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 7562d5717ca94c509dd7ac6aea987565 Aug 31 11:55:05.705269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-VolumesNegativeTest-1016849367 Aug 31 11:55:05.705269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-VolumesNegativeTest-1016849367-project Aug 31 11:55:05.705269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:55:05.705269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:55:05.705269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: e55afbd435694ea0b9ea0d1a19a4abdb Aug 31 11:55:05.705269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-VolumesNegativeTest-1016849367-project Aug 31 11:55:05.705269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: Aug 31 11:55:05.705269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Volume 887cfd43-22b4-4155-b119-32be6cc51af8 could not be found. Aug 31 11:55:05.705269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': '887cfd43-22b4-4155-b119-32be6cc51af8'} Aug 31 11:55:05.705269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 887cfd43-22b4-4155-b119-32be6cc51af8 could not be found. (HTTP 404) (Request-ID: req-56323a83-da73-4add-957c-4c8e256973ec) Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:05.706406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:55:05.707654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 887cfd43-22b4-4155-b119-32be6cc51af8 could not be found. Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 11:55:05.708896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:55:05.710398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 887cfd43-22b4-4155-b119-32be6cc51af8 could not be found. Aug 31 11:55:05.710398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.710398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:55:05.710398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.710398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:55:05.710398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:55:05.710398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:55:05.710398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:55:05.710398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:55:05.710398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 887cfd43-22b4-4155-b119-32be6cc51af8 could not be found. Aug 31 11:55:05.710398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:55:05.713609 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-19b2d09d-142b-4d10-923f-88a4c2bdb663 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] Returning 404 to user: Volume 887cfd43-22b4-4155-b119-32be6cc51af8 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:55:05.714524 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-19b2d09d-142b-4d10-923f-88a4c2bdb663 tempest-VolumesNegativeTest-1016849367 tempest-VolumesNegativeTest-1016849367-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/887cfd43-22b4-4155-b119-32be6cc51af8" status: 404 len: 109 microversion: 2.1 time: 0.065342 Aug 31 11:55:05.715075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 646/1276] 10.222.0.60 () {58 vars in 1245 bytes} [Wed Aug 31 11:55:05 2022] GET /compute/v2.1/os-volumes/887cfd43-22b4-4155-b119-32be6cc51af8 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:56:06.612131 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-84554bb1-3776-467f-b0d7-a5bf5edfc3da tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Action: 'create', calling method: .version_select at 0x7f17381ae1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-379067288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+VQ0ZvrKQRkKBHEdr4VZyqqF4EORfRAfkn339I/6lm3e9d4GKFpdehGjRnCpmxwPhPhl3KIpnn+DMmIECr8Y1V2LKx9zBoAMvjEOjODczwl2oEpohPKnlT5EbVjoPJ1w=="}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:56:06.633477 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-84554bb1-3776-467f-b0d7-a5bf5edfc3da tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Getting quotas for project fe46592aea54410c9f49a0371bb2bc73. Resources: {'key_pairs'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:56:06.638269 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-84554bb1-3776-467f-b0d7-a5bf5edfc3da tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Getting quotas for user c6d4923a511342248e34954fc44811c0 and project fe46592aea54410c9f49a0371bb2bc73. Resources: {'key_pairs'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:56:06.665774 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-84554bb1-3776-467f-b0d7-a5bf5edfc3da tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.273890 Aug 31 11:56:06.666389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 631/1277] 10.222.0.60 () {60 vars in 1159 bytes} [Wed Aug 31 11:56:06 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:56:37.903204 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 11:56:37.903745 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Wed Aug 31 11:56:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Aug 31 11:56:37.909841 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-261888331", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-379067288", "security_groups": [{"name": "tempest-secgroup-smoke-871307451"}], "block_device_mapping_v2": [{"uuid": "27c3f748-b162-4dde-a6dc-256c3c79ac75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "87aea852-8a87-40d1-89ab-b1ccf4cde936"}]}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:56:38.025730 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.network.neutron [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] validate_networks() for [('87aea852-8a87-40d1-89ab-b1ccf4cde936', None, None, None, None, None)] {{(pid=127062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:56:38.503429 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Flavor limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:56:38.503850 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Image limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:56:38.504344 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Flavor pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:56:38.504776 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Image pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:56:38.505183 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:56:38.513973 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:38.514451 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:38.514884 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:38.515604 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:38.516053 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:38.516480 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:38.534143 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Getting quotas for project fe46592aea54410c9f49a0371bb2bc73. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:56:38.538029 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Getting quotas for user c6d4923a511342248e34954fc44811c0 and project fe46592aea54410c9f49a0371bb2bc73. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:56:38.595240 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Going to run 1 instances... {{(pid=127062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:56:38.597696 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='27c3f748-b162-4dde-a6dc-256c3c79ac75',volume_size=None,volume_type=None)] {{(pid=127062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:56:38.729272 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ea4be2a8-316a-4d08-b6cf-fad289f59532 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.828740 Aug 31 11:56:38.729926 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 647/1278] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:56:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:56:38.739355 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=4 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:56:38.740283 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:56:38.744309 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e0b5c4fe-19ad-40ac-9910-dae88dc76f4d tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:38.745260 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e0b5c4fe-19ad-40ac-9910-dae88dc76f4d tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:38.808383 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e0b5c4fe-19ad-40ac-9910-dae88dc76f4d tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:38.817406 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e0b5c4fe-19ad-40ac-9910-dae88dc76f4d tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1093 microversion: 2.1 time: 0.079611 Aug 31 11:56:38.817968 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 632/1279] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:38 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:39.838132 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b204f512-e996-4d54-a21d-ed98ca8a4ba1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:39.838718 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b204f512-e996-4d54-a21d-ed98ca8a4ba1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:39.846087 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b204f512-e996-4d54-a21d-ed98ca8a4ba1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:39.846567 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b204f512-e996-4d54-a21d-ed98ca8a4ba1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:39.846995 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b204f512-e996-4d54-a21d-ed98ca8a4ba1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:39.847670 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b204f512-e996-4d54-a21d-ed98ca8a4ba1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:39.848112 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b204f512-e996-4d54-a21d-ed98ca8a4ba1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:39.848551 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b204f512-e996-4d54-a21d-ed98ca8a4ba1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:39.907348 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b204f512-e996-4d54-a21d-ed98ca8a4ba1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:39.915514 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b204f512-e996-4d54-a21d-ed98ca8a4ba1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1143 microversion: 2.1 time: 0.081706 Aug 31 11:56:39.916069 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 648/1280] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:39 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:40.936618 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4a260838-333a-45ad-95cf-c89ba19f0f87 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:40.937194 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4a260838-333a-45ad-95cf-c89ba19f0f87 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:40.946097 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4a260838-333a-45ad-95cf-c89ba19f0f87 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:40.946586 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4a260838-333a-45ad-95cf-c89ba19f0f87 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:40.947020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4a260838-333a-45ad-95cf-c89ba19f0f87 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:40.947713 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4a260838-333a-45ad-95cf-c89ba19f0f87 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:40.948302 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4a260838-333a-45ad-95cf-c89ba19f0f87 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:40.948756 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4a260838-333a-45ad-95cf-c89ba19f0f87 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:41.016547 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4a260838-333a-45ad-95cf-c89ba19f0f87 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:41.024537 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4a260838-333a-45ad-95cf-c89ba19f0f87 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1143 microversion: 2.1 time: 0.091895 Aug 31 11:56:41.025112 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 633/1281] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:40 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1143 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:42.045616 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a7edfea3-832a-4758-89c6-d72d057c3334 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:42.046296 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a7edfea3-832a-4758-89c6-d72d057c3334 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:42.053651 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a7edfea3-832a-4758-89c6-d72d057c3334 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:42.054131 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a7edfea3-832a-4758-89c6-d72d057c3334 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:42.054579 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a7edfea3-832a-4758-89c6-d72d057c3334 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:42.055265 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a7edfea3-832a-4758-89c6-d72d057c3334 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:42.055704 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a7edfea3-832a-4758-89c6-d72d057c3334 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:42.056122 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a7edfea3-832a-4758-89c6-d72d057c3334 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:42.124151 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a7edfea3-832a-4758-89c6-d72d057c3334 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:42.132941 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a7edfea3-832a-4758-89c6-d72d057c3334 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1209 microversion: 2.1 time: 0.091245 Aug 31 11:56:42.133518 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 649/1282] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:42 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:43.068049 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-df83b094-6052-4cc2-9239-8940579b5ab5 req-28e6b8ba-7b09-4c3d-9849-251737d9a657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c016285-8d0b-49ea-9722-3ec6f878f274", "tag": "ca9a2e92-d016-480c-8ca0-64a8dc7c7119"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:56:43.078306 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-df83b094-6052-4cc2-9239-8940579b5ab5 req-28e6b8ba-7b09-4c3d-9849-251737d9a657 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:43.078306 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-df83b094-6052-4cc2-9239-8940579b5ab5 req-28e6b8ba-7b09-4c3d-9849-251737d9a657 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:43.078306 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-df83b094-6052-4cc2-9239-8940579b5ab5 req-28e6b8ba-7b09-4c3d-9849-251737d9a657 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:43.089369 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-df83b094-6052-4cc2-9239-8940579b5ab5 req-28e6b8ba-7b09-4c3d-9849-251737d9a657 service nova] Creating event network-changed:ca9a2e92-d016-480c-8ca0-64a8dc7c7119 for instance 3c016285-8d0b-49ea-9722-3ec6f878f274 on hv-cinder-83976 Aug 31 11:56:43.094310 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-df83b094-6052-4cc2-9239-8940579b5ab5 req-28e6b8ba-7b09-4c3d-9849-251737d9a657 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104586 Aug 31 11:56:43.095465 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 634/1283] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:56:43.158137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ccaaf97d-aa28-43e9-941f-f9b7e482d672 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:43.159145 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ccaaf97d-aa28-43e9-941f-f9b7e482d672 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:43.165850 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ccaaf97d-aa28-43e9-941f-f9b7e482d672 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:43.166351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ccaaf97d-aa28-43e9-941f-f9b7e482d672 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:43.166768 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ccaaf97d-aa28-43e9-941f-f9b7e482d672 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:43.167459 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ccaaf97d-aa28-43e9-941f-f9b7e482d672 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:43.167911 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ccaaf97d-aa28-43e9-941f-f9b7e482d672 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:43.168332 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ccaaf97d-aa28-43e9-941f-f9b7e482d672 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:43.301893 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ccaaf97d-aa28-43e9-941f-f9b7e482d672 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:43.309668 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ccaaf97d-aa28-43e9-941f-f9b7e482d672 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1264 microversion: 2.1 time: 0.156071 Aug 31 11:56:43.312090 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 650/1284] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:43 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:44.332143 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-455d7b3c-e8f7-4732-91d4-f335f11dc50f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:44.332867 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-455d7b3c-e8f7-4732-91d4-f335f11dc50f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:44.339017 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-455d7b3c-e8f7-4732-91d4-f335f11dc50f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:44.339496 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-455d7b3c-e8f7-4732-91d4-f335f11dc50f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:44.339935 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-455d7b3c-e8f7-4732-91d4-f335f11dc50f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:44.340658 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-455d7b3c-e8f7-4732-91d4-f335f11dc50f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:44.341118 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-455d7b3c-e8f7-4732-91d4-f335f11dc50f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:44.341542 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-455d7b3c-e8f7-4732-91d4-f335f11dc50f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:44.561471 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-455d7b3c-e8f7-4732-91d4-f335f11dc50f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:44.570664 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-455d7b3c-e8f7-4732-91d4-f335f11dc50f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1264 microversion: 2.1 time: 0.243267 Aug 31 11:56:44.571243 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 635/1285] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:44 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1264 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:45.591190 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-86d2b7ad-a5f5-4ca6-bc61-842e5be536b1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:45.591785 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-86d2b7ad-a5f5-4ca6-bc61-842e5be536b1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:45.598983 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-86d2b7ad-a5f5-4ca6-bc61-842e5be536b1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:45.599463 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-86d2b7ad-a5f5-4ca6-bc61-842e5be536b1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:45.599895 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-86d2b7ad-a5f5-4ca6-bc61-842e5be536b1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:45.600608 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-86d2b7ad-a5f5-4ca6-bc61-842e5be536b1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:45.601055 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-86d2b7ad-a5f5-4ca6-bc61-842e5be536b1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:45.601477 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-86d2b7ad-a5f5-4ca6-bc61-842e5be536b1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:45.732696 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-86d2b7ad-a5f5-4ca6-bc61-842e5be536b1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:45.740399 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-86d2b7ad-a5f5-4ca6-bc61-842e5be536b1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1264 microversion: 2.1 time: 0.153105 Aug 31 11:56:45.740993 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 651/1286] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:45 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:46.761797 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-71fafd72-4531-44e8-92df-ed539bc3197a tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:46.762407 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-71fafd72-4531-44e8-92df-ed539bc3197a tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:46.769470 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71fafd72-4531-44e8-92df-ed539bc3197a tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:46.769952 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71fafd72-4531-44e8-92df-ed539bc3197a tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:46.770809 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71fafd72-4531-44e8-92df-ed539bc3197a tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:46.771689 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71fafd72-4531-44e8-92df-ed539bc3197a tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:46.772140 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71fafd72-4531-44e8-92df-ed539bc3197a tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:46.772589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-71fafd72-4531-44e8-92df-ed539bc3197a tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:46.924661 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-71fafd72-4531-44e8-92df-ed539bc3197a tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:46.933057 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-71fafd72-4531-44e8-92df-ed539bc3197a tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1264 microversion: 2.1 time: 0.175726 Aug 31 11:56:46.934462 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 636/1287] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:46 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:47.955336 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-560279f5-5046-40af-b298-2ab43f7cf1cc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:47.956001 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-560279f5-5046-40af-b298-2ab43f7cf1cc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:47.962396 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-560279f5-5046-40af-b298-2ab43f7cf1cc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:47.962887 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-560279f5-5046-40af-b298-2ab43f7cf1cc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:47.963322 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-560279f5-5046-40af-b298-2ab43f7cf1cc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:47.964011 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-560279f5-5046-40af-b298-2ab43f7cf1cc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:47.964462 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-560279f5-5046-40af-b298-2ab43f7cf1cc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:47.964911 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-560279f5-5046-40af-b298-2ab43f7cf1cc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:48.109607 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-560279f5-5046-40af-b298-2ab43f7cf1cc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:48.118008 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-560279f5-5046-40af-b298-2ab43f7cf1cc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1264 microversion: 2.1 time: 0.166758 Aug 31 11:56:48.118577 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 652/1288] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:47 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:49.138668 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2d0fff54-4ad2-4f84-8c8b-60bea8cca350 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:49.139281 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2d0fff54-4ad2-4f84-8c8b-60bea8cca350 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:49.142576 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:56:49.147782 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d0fff54-4ad2-4f84-8c8b-60bea8cca350 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:49.148337 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d0fff54-4ad2-4f84-8c8b-60bea8cca350 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:49.148868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d0fff54-4ad2-4f84-8c8b-60bea8cca350 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:49.149629 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d0fff54-4ad2-4f84-8c8b-60bea8cca350 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:49.150082 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d0fff54-4ad2-4f84-8c8b-60bea8cca350 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:49.150503 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d0fff54-4ad2-4f84-8c8b-60bea8cca350 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:49.280242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2d0fff54-4ad2-4f84-8c8b-60bea8cca350 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:49.287929 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2d0fff54-4ad2-4f84-8c8b-60bea8cca350 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1264 microversion: 2.1 time: 0.153163 Aug 31 11:56:49.288504 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 637/1289] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:49 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:50.309531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-84575cca-2e6e-4147-87d6-de2b6c4e1ec3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:50.310118 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-84575cca-2e6e-4147-87d6-de2b6c4e1ec3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:50.311841 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:56:50.312481 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=6 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:56:50.319216 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-84575cca-2e6e-4147-87d6-de2b6c4e1ec3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:50.319687 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-84575cca-2e6e-4147-87d6-de2b6c4e1ec3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:50.320111 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-84575cca-2e6e-4147-87d6-de2b6c4e1ec3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:50.320819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-84575cca-2e6e-4147-87d6-de2b6c4e1ec3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:50.321261 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-84575cca-2e6e-4147-87d6-de2b6c4e1ec3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:50.321676 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-84575cca-2e6e-4147-87d6-de2b6c4e1ec3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:50.455737 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-84575cca-2e6e-4147-87d6-de2b6c4e1ec3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:50.463406 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-84575cca-2e6e-4147-87d6-de2b6c4e1ec3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1264 microversion: 2.1 time: 0.157833 Aug 31 11:56:50.464043 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 653/1290] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:50 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:51.484019 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-0a9ea612-ff7a-4bc8-9a14-c9fe148b59bb tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:51.484591 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-0a9ea612-ff7a-4bc8-9a14-c9fe148b59bb tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:51.490990 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a9ea612-ff7a-4bc8-9a14-c9fe148b59bb tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:51.491465 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a9ea612-ff7a-4bc8-9a14-c9fe148b59bb tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:51.491895 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a9ea612-ff7a-4bc8-9a14-c9fe148b59bb tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:51.492603 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a9ea612-ff7a-4bc8-9a14-c9fe148b59bb tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:51.493056 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a9ea612-ff7a-4bc8-9a14-c9fe148b59bb tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:51.493474 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-0a9ea612-ff7a-4bc8-9a14-c9fe148b59bb tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:51.622402 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-0a9ea612-ff7a-4bc8-9a14-c9fe148b59bb tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:51.631020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-0a9ea612-ff7a-4bc8-9a14-c9fe148b59bb tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1264 microversion: 2.1 time: 0.150801 Aug 31 11:56:51.631700 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 638/1291] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:51 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:52.652706 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f6a31a1e-2be9-4b7e-bd0a-7ee0c9e09ca8 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:52.653307 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f6a31a1e-2be9-4b7e-bd0a-7ee0c9e09ca8 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:52.660308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6a31a1e-2be9-4b7e-bd0a-7ee0c9e09ca8 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:52.660808 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6a31a1e-2be9-4b7e-bd0a-7ee0c9e09ca8 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:52.661234 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6a31a1e-2be9-4b7e-bd0a-7ee0c9e09ca8 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:52.661912 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6a31a1e-2be9-4b7e-bd0a-7ee0c9e09ca8 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:52.662354 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6a31a1e-2be9-4b7e-bd0a-7ee0c9e09ca8 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:52.662769 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f6a31a1e-2be9-4b7e-bd0a-7ee0c9e09ca8 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:52.795580 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f6a31a1e-2be9-4b7e-bd0a-7ee0c9e09ca8 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:52.803927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f6a31a1e-2be9-4b7e-bd0a-7ee0c9e09ca8 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1264 microversion: 2.1 time: 0.155043 Aug 31 11:56:52.804531 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 654/1292] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:52 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:53.824875 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4c08a8c0-7c34-4347-b9f6-5d8af789c753 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:53.825484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4c08a8c0-7c34-4347-b9f6-5d8af789c753 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:53.831917 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c08a8c0-7c34-4347-b9f6-5d8af789c753 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:53.832393 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c08a8c0-7c34-4347-b9f6-5d8af789c753 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:53.832859 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c08a8c0-7c34-4347-b9f6-5d8af789c753 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:53.833544 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c08a8c0-7c34-4347-b9f6-5d8af789c753 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:53.833992 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c08a8c0-7c34-4347-b9f6-5d8af789c753 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:53.834419 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c08a8c0-7c34-4347-b9f6-5d8af789c753 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:53.967740 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4c08a8c0-7c34-4347-b9f6-5d8af789c753 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:53.975934 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4c08a8c0-7c34-4347-b9f6-5d8af789c753 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1264 microversion: 2.1 time: 0.155023 Aug 31 11:56:53.976520 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 639/1293] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:53 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:54.997633 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-94261746-114e-4745-916f-5c4af6757eca tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:54.998302 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-94261746-114e-4745-916f-5c4af6757eca tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:55.005074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94261746-114e-4745-916f-5c4af6757eca tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:55.005620 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94261746-114e-4745-916f-5c4af6757eca tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:55.006117 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94261746-114e-4745-916f-5c4af6757eca tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:55.006861 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94261746-114e-4745-916f-5c4af6757eca tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:55.007372 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94261746-114e-4745-916f-5c4af6757eca tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:55.007870 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94261746-114e-4745-916f-5c4af6757eca tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:55.096908 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-49ba26f6-fff9-4c2e-8076-210c694f707e req-5cc81dbe-2fb4-4e0c-a7c8-de396ca6ce67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c016285-8d0b-49ea-9722-3ec6f878f274", "name": "network-vif-plugged", "status": "completed", "tag": "ca9a2e92-d016-480c-8ca0-64a8dc7c7119"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:56:55.106723 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-49ba26f6-fff9-4c2e-8076-210c694f707e req-5cc81dbe-2fb4-4e0c-a7c8-de396ca6ce67 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:55.107287 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-49ba26f6-fff9-4c2e-8076-210c694f707e req-5cc81dbe-2fb4-4e0c-a7c8-de396ca6ce67 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:55.107783 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-49ba26f6-fff9-4c2e-8076-210c694f707e req-5cc81dbe-2fb4-4e0c-a7c8-de396ca6ce67 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:55.119203 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-49ba26f6-fff9-4c2e-8076-210c694f707e req-5cc81dbe-2fb4-4e0c-a7c8-de396ca6ce67 service nova] Creating event network-vif-plugged:ca9a2e92-d016-480c-8ca0-64a8dc7c7119 for instance 3c016285-8d0b-49ea-9722-3ec6f878f274 on hv-cinder-83976 Aug 31 11:56:55.125986 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-49ba26f6-fff9-4c2e-8076-210c694f707e req-5cc81dbe-2fb4-4e0c-a7c8-de396ca6ce67 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219901 Aug 31 11:56:55.127134 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 655/1294] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:56:55.142639 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-94261746-114e-4745-916f-5c4af6757eca tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:55.150735 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-94261746-114e-4745-916f-5c4af6757eca tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1264 microversion: 2.1 time: 0.157284 Aug 31 11:56:55.151310 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 640/1295] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:54 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:56:56.173303 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-d2858ac6-9671-4d20-9ebc-2efd3ea88ea5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:56.174004 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-d2858ac6-9671-4d20-9ebc-2efd3ea88ea5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:56.180618 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d2858ac6-9671-4d20-9ebc-2efd3ea88ea5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:56.181096 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d2858ac6-9671-4d20-9ebc-2efd3ea88ea5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:56.181526 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d2858ac6-9671-4d20-9ebc-2efd3ea88ea5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:56.182235 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d2858ac6-9671-4d20-9ebc-2efd3ea88ea5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:56.182681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d2858ac6-9671-4d20-9ebc-2efd3ea88ea5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:56.183101 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-d2858ac6-9671-4d20-9ebc-2efd3ea88ea5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:56.314803 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-d2858ac6-9671-4d20-9ebc-2efd3ea88ea5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:56.323082 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-d2858ac6-9671-4d20-9ebc-2efd3ea88ea5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1264 microversion: 2.1 time: 0.154973 Aug 31 11:56:56.323652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 656/1296] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:56 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:57.343975 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4606357e-c7d4-49a5-bf47-d2c83728fed5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:57.345145 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4606357e-c7d4-49a5-bf47-d2c83728fed5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:57.351526 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4606357e-c7d4-49a5-bf47-d2c83728fed5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:57.352004 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4606357e-c7d4-49a5-bf47-d2c83728fed5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:57.352436 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4606357e-c7d4-49a5-bf47-d2c83728fed5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:57.353142 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4606357e-c7d4-49a5-bf47-d2c83728fed5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:57.353597 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4606357e-c7d4-49a5-bf47-d2c83728fed5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:57.354017 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4606357e-c7d4-49a5-bf47-d2c83728fed5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:57.483598 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4606357e-c7d4-49a5-bf47-d2c83728fed5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:57.492545 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4606357e-c7d4-49a5-bf47-d2c83728fed5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1450 microversion: 2.1 time: 0.152344 Aug 31 11:56:57.493253 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 641/1297] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:57 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:57.515283 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-8593091d-9eb2-489b-91d6-d5d31f396ae6 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:56:57.515889 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-8593091d-9eb2-489b-91d6-d5d31f396ae6 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:56:57.523237 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8593091d-9eb2-489b-91d6-d5d31f396ae6 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:57.523716 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8593091d-9eb2-489b-91d6-d5d31f396ae6 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:57.524145 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8593091d-9eb2-489b-91d6-d5d31f396ae6 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:57.524859 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8593091d-9eb2-489b-91d6-d5d31f396ae6 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:57.525305 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8593091d-9eb2-489b-91d6-d5d31f396ae6 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:57.525726 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-8593091d-9eb2-489b-91d6-d5d31f396ae6 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:57.655232 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-8593091d-9eb2-489b-91d6-d5d31f396ae6 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:56:57.663712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-8593091d-9eb2-489b-91d6-d5d31f396ae6 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1450 microversion: 2.1 time: 0.152240 Aug 31 11:56:57.664276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 657/1298] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:56:57 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:56:59.775224 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-2cc3ffc2-0b0f-4103-8ff4-b2807acf29af req-5161a9b1-eb34-4619-9b7d-9ab3a35528bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c016285-8d0b-49ea-9722-3ec6f878f274", "tag": "ca9a2e92-d016-480c-8ca0-64a8dc7c7119"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:56:59.785355 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-2cc3ffc2-0b0f-4103-8ff4-b2807acf29af req-5161a9b1-eb34-4619-9b7d-9ab3a35528bb service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:56:59.785843 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-2cc3ffc2-0b0f-4103-8ff4-b2807acf29af req-5161a9b1-eb34-4619-9b7d-9ab3a35528bb service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:56:59.786261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-2cc3ffc2-0b0f-4103-8ff4-b2807acf29af req-5161a9b1-eb34-4619-9b7d-9ab3a35528bb service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:56:59.798199 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-2cc3ffc2-0b0f-4103-8ff4-b2807acf29af req-5161a9b1-eb34-4619-9b7d-9ab3a35528bb service nova] Creating event network-changed:ca9a2e92-d016-480c-8ca0-64a8dc7c7119 for instance 3c016285-8d0b-49ea-9722-3ec6f878f274 on hv-cinder-83976 Aug 31 11:56:59.803466 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-2cc3ffc2-0b0f-4103-8ff4-b2807acf29af req-5161a9b1-eb34-4619-9b7d-9ab3a35528bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031889 Aug 31 11:56:59.804068 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 642/1299] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:57:35.341501 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-6fd607d7-6312-43a4-ae97-35b5ebf33821 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:57:35.342145 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-6fd607d7-6312-43a4-ae97-35b5ebf33821 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:35.344400 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:57:35.345113 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=58 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:57:35.351308 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6fd607d7-6312-43a4-ae97-35b5ebf33821 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:35.351886 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6fd607d7-6312-43a4-ae97-35b5ebf33821 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:35.352241 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6fd607d7-6312-43a4-ae97-35b5ebf33821 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:35.352977 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6fd607d7-6312-43a4-ae97-35b5ebf33821 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:35.353429 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6fd607d7-6312-43a4-ae97-35b5ebf33821 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:35.353854 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-6fd607d7-6312-43a4-ae97-35b5ebf33821 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:35.381956 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.objects.instance [None req-6fd607d7-6312-43a4-ae97-35b5ebf33821 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lazy-loading 'flavor' on Instance uuid cae99bf4-5a13-4a75-9b1d-74322674eef7 {{(pid=127062) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:57:35.473161 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-6fd607d7-6312-43a4-ae97-35b5ebf33821 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "POST /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7/action" status: 202 len: 0 microversion: 2.1 time: 0.135576 Aug 31 11:57:35.473764 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 658/1300] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 31 11:57:35 2022] POST /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:57:35.480076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=24 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:57:35.480839 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=52 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:57:35.485798 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-94b6bdda-45e9-4fe6-85f1-521d8812431d tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:35.486499 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-94b6bdda-45e9-4fe6-85f1-521d8812431d tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:35.495359 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94b6bdda-45e9-4fe6-85f1-521d8812431d tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:35.495816 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94b6bdda-45e9-4fe6-85f1-521d8812431d tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:35.496241 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94b6bdda-45e9-4fe6-85f1-521d8812431d tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:35.496964 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94b6bdda-45e9-4fe6-85f1-521d8812431d tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:35.497414 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94b6bdda-45e9-4fe6-85f1-521d8812431d tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:35.497832 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-94b6bdda-45e9-4fe6-85f1-521d8812431d tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:35.667893 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-94b6bdda-45e9-4fe6-85f1-521d8812431d tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:35.679256 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-94b6bdda-45e9-4fe6-85f1-521d8812431d tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1570 microversion: 2.1 time: 0.200577 Aug 31 11:57:35.680613 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 643/1301] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:35 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1570 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:36.707393 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-2ed864cb-3f56-4277-8be4-642622a6326b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:36.708090 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-2ed864cb-3f56-4277-8be4-642622a6326b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:36.714280 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ed864cb-3f56-4277-8be4-642622a6326b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:36.714762 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ed864cb-3f56-4277-8be4-642622a6326b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:36.715195 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ed864cb-3f56-4277-8be4-642622a6326b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:36.715883 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ed864cb-3f56-4277-8be4-642622a6326b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:36.716331 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ed864cb-3f56-4277-8be4-642622a6326b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:36.716849 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-2ed864cb-3f56-4277-8be4-642622a6326b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:36.858886 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-2ed864cb-3f56-4277-8be4-642622a6326b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:36.866681 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-2ed864cb-3f56-4277-8be4-642622a6326b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1570 microversion: 2.1 time: 0.164732 Aug 31 11:57:36.867275 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 659/1302] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:36 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:37.888893 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2d126116-9145-4fbc-b191-25b6227c77d4 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:37.889503 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2d126116-9145-4fbc-b191-25b6227c77d4 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:37.896351 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d126116-9145-4fbc-b191-25b6227c77d4 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:37.896863 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d126116-9145-4fbc-b191-25b6227c77d4 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:37.897300 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d126116-9145-4fbc-b191-25b6227c77d4 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:37.897991 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d126116-9145-4fbc-b191-25b6227c77d4 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:37.898440 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d126116-9145-4fbc-b191-25b6227c77d4 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:37.898870 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2d126116-9145-4fbc-b191-25b6227c77d4 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:38.033242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2d126116-9145-4fbc-b191-25b6227c77d4 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:38.041042 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2d126116-9145-4fbc-b191-25b6227c77d4 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1570 microversion: 2.1 time: 0.156024 Aug 31 11:57:38.041613 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 644/1303] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:37 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:39.063058 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-da07680f-fbbf-4d84-b963-f22bb2593e0e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:39.063652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-da07680f-fbbf-4d84-b963-f22bb2593e0e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:39.070231 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da07680f-fbbf-4d84-b963-f22bb2593e0e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:39.070710 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da07680f-fbbf-4d84-b963-f22bb2593e0e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:39.071137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da07680f-fbbf-4d84-b963-f22bb2593e0e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:39.071813 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da07680f-fbbf-4d84-b963-f22bb2593e0e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:39.072258 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da07680f-fbbf-4d84-b963-f22bb2593e0e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:39.072712 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-da07680f-fbbf-4d84-b963-f22bb2593e0e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:39.212638 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-da07680f-fbbf-4d84-b963-f22bb2593e0e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:39.221431 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-da07680f-fbbf-4d84-b963-f22bb2593e0e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1570 microversion: 2.1 time: 0.162719 Aug 31 11:57:39.221999 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 660/1304] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:39 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:40.242808 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-09a4eeb4-53fb-4269-8e6e-5e753b3f91b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:40.243388 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-09a4eeb4-53fb-4269-8e6e-5e753b3f91b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:40.250121 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-09a4eeb4-53fb-4269-8e6e-5e753b3f91b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:40.250599 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-09a4eeb4-53fb-4269-8e6e-5e753b3f91b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:40.251035 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-09a4eeb4-53fb-4269-8e6e-5e753b3f91b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:40.251732 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-09a4eeb4-53fb-4269-8e6e-5e753b3f91b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:40.252183 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-09a4eeb4-53fb-4269-8e6e-5e753b3f91b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:40.252642 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-09a4eeb4-53fb-4269-8e6e-5e753b3f91b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:40.388930 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-09a4eeb4-53fb-4269-8e6e-5e753b3f91b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:40.397273 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-09a4eeb4-53fb-4269-8e6e-5e753b3f91b5 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1570 microversion: 2.1 time: 0.158401 Aug 31 11:57:40.397833 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 645/1305] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:40 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:41.418426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-0a2d9fc0-f804-4f39-86ea-6b2b81ed2bcd tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:41.419020 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-0a2d9fc0-f804-4f39-86ea-6b2b81ed2bcd tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:41.426688 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a2d9fc0-f804-4f39-86ea-6b2b81ed2bcd tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:41.427170 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a2d9fc0-f804-4f39-86ea-6b2b81ed2bcd tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:41.427606 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a2d9fc0-f804-4f39-86ea-6b2b81ed2bcd tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:41.428300 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a2d9fc0-f804-4f39-86ea-6b2b81ed2bcd tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:41.428780 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a2d9fc0-f804-4f39-86ea-6b2b81ed2bcd tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:41.429206 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-0a2d9fc0-f804-4f39-86ea-6b2b81ed2bcd tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:41.566515 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-0a2d9fc0-f804-4f39-86ea-6b2b81ed2bcd tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:41.574341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-0a2d9fc0-f804-4f39-86ea-6b2b81ed2bcd tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1570 microversion: 2.1 time: 0.159779 Aug 31 11:57:41.574903 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 661/1306] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:41 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:42.596188 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6e358d8c-5fdc-4ff7-b371-a6609264b123 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:42.597031 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6e358d8c-5fdc-4ff7-b371-a6609264b123 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:42.603643 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e358d8c-5fdc-4ff7-b371-a6609264b123 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:42.604113 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e358d8c-5fdc-4ff7-b371-a6609264b123 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:42.604656 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e358d8c-5fdc-4ff7-b371-a6609264b123 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:42.605402 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e358d8c-5fdc-4ff7-b371-a6609264b123 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:42.605937 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e358d8c-5fdc-4ff7-b371-a6609264b123 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:42.606531 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6e358d8c-5fdc-4ff7-b371-a6609264b123 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:42.758382 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6e358d8c-5fdc-4ff7-b371-a6609264b123 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:42.766293 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6e358d8c-5fdc-4ff7-b371-a6609264b123 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1570 microversion: 2.1 time: 0.174434 Aug 31 11:57:42.766853 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 646/1307] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:42 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:43.789320 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-371eeb28-8304-47bb-9126-f49b1b76aa39 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:43.789915 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-371eeb28-8304-47bb-9126-f49b1b76aa39 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:43.797426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-371eeb28-8304-47bb-9126-f49b1b76aa39 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:43.797913 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-371eeb28-8304-47bb-9126-f49b1b76aa39 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:43.798348 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-371eeb28-8304-47bb-9126-f49b1b76aa39 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:43.799043 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-371eeb28-8304-47bb-9126-f49b1b76aa39 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:43.799495 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-371eeb28-8304-47bb-9126-f49b1b76aa39 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:43.799919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-371eeb28-8304-47bb-9126-f49b1b76aa39 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:43.941315 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-371eeb28-8304-47bb-9126-f49b1b76aa39 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:43.949065 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-371eeb28-8304-47bb-9126-f49b1b76aa39 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1570 microversion: 2.1 time: 0.163601 Aug 31 11:57:43.949629 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 662/1308] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:43 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:44.973613 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-9bf32a85-8dc0-4ae5-b026-8a1fb0db1d72 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:44.974185 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-9bf32a85-8dc0-4ae5-b026-8a1fb0db1d72 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:44.980546 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bf32a85-8dc0-4ae5-b026-8a1fb0db1d72 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:44.981041 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bf32a85-8dc0-4ae5-b026-8a1fb0db1d72 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:44.981471 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bf32a85-8dc0-4ae5-b026-8a1fb0db1d72 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:44.982148 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bf32a85-8dc0-4ae5-b026-8a1fb0db1d72 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:44.982589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bf32a85-8dc0-4ae5-b026-8a1fb0db1d72 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:44.983005 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-9bf32a85-8dc0-4ae5-b026-8a1fb0db1d72 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:45.120272 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-9bf32a85-8dc0-4ae5-b026-8a1fb0db1d72 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:45.128255 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-9bf32a85-8dc0-4ae5-b026-8a1fb0db1d72 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1570 microversion: 2.1 time: 0.158622 Aug 31 11:57:45.128846 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 647/1309] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:44 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:46.149265 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-94019901-54fe-4841-8261-c18126b3c387 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:46.149857 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-94019901-54fe-4841-8261-c18126b3c387 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:46.157708 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-94019901-54fe-4841-8261-c18126b3c387 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:46.158332 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-94019901-54fe-4841-8261-c18126b3c387 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:46.158768 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-94019901-54fe-4841-8261-c18126b3c387 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:46.159468 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-94019901-54fe-4841-8261-c18126b3c387 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:46.159950 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-94019901-54fe-4841-8261-c18126b3c387 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:46.160377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-94019901-54fe-4841-8261-c18126b3c387 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:46.297154 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-94019901-54fe-4841-8261-c18126b3c387 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:46.305320 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-94019901-54fe-4841-8261-c18126b3c387 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1570 microversion: 2.1 time: 0.159903 Aug 31 11:57:46.305899 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 663/1310] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:46 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:47.327888 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6f0b3f0a-b58f-4ca5-a8b6-17997fb42a1e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:47.328622 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6f0b3f0a-b58f-4ca5-a8b6-17997fb42a1e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:47.334842 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6f0b3f0a-b58f-4ca5-a8b6-17997fb42a1e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:47.335317 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6f0b3f0a-b58f-4ca5-a8b6-17997fb42a1e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:47.335744 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6f0b3f0a-b58f-4ca5-a8b6-17997fb42a1e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:47.336431 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6f0b3f0a-b58f-4ca5-a8b6-17997fb42a1e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:47.336902 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6f0b3f0a-b58f-4ca5-a8b6-17997fb42a1e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:47.337324 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6f0b3f0a-b58f-4ca5-a8b6-17997fb42a1e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:47.474363 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-6f0b3f0a-b58f-4ca5-a8b6-17997fb42a1e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:47.482329 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6f0b3f0a-b58f-4ca5-a8b6-17997fb42a1e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1570 microversion: 2.1 time: 0.159001 Aug 31 11:57:47.482882 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 648/1311] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:47 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:48.503671 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-c14287e2-c622-458e-9e32-d9aed21f16aa tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:48.504238 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-c14287e2-c622-458e-9e32-d9aed21f16aa tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:48.510991 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c14287e2-c622-458e-9e32-d9aed21f16aa tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:48.511469 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c14287e2-c622-458e-9e32-d9aed21f16aa tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:48.512052 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c14287e2-c622-458e-9e32-d9aed21f16aa tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:48.512890 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c14287e2-c622-458e-9e32-d9aed21f16aa tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:48.513353 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c14287e2-c622-458e-9e32-d9aed21f16aa tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:48.513774 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-c14287e2-c622-458e-9e32-d9aed21f16aa tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:48.654872 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-c14287e2-c622-458e-9e32-d9aed21f16aa tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:48.663538 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-c14287e2-c622-458e-9e32-d9aed21f16aa tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1571 microversion: 2.1 time: 0.163940 Aug 31 11:57:48.664108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 664/1312] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:48 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:48.683655 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2922bfe6-1525-4293-a463-fde626a05048 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:57:48.684250 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2922bfe6-1525-4293-a463-fde626a05048 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:48.691431 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2922bfe6-1525-4293-a463-fde626a05048 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:48.691913 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2922bfe6-1525-4293-a463-fde626a05048 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:48.692347 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2922bfe6-1525-4293-a463-fde626a05048 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:48.693071 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2922bfe6-1525-4293-a463-fde626a05048 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:48.693522 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2922bfe6-1525-4293-a463-fde626a05048 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:48.693943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2922bfe6-1525-4293-a463-fde626a05048 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:48.779772 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2922bfe6-1525-4293-a463-fde626a05048 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127061) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 11:57:48.849115 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2922bfe6-1525-4293-a463-fde626a05048 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "POST /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7/action" status: 202 len: 0 microversion: 2.1 time: 0.169113 Aug 31 11:57:48.849913 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 649/1313] 10.222.0.60 () {60 vars in 1278 bytes} [Wed Aug 31 11:57:48 2022] POST /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:57:48.857984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a54f66f5-8f9a-4ef8-8f5a-29dab44acd5a tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:48.858593 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a54f66f5-8f9a-4ef8-8f5a-29dab44acd5a tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:48.864526 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a54f66f5-8f9a-4ef8-8f5a-29dab44acd5a tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:48.865007 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a54f66f5-8f9a-4ef8-8f5a-29dab44acd5a tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:48.865433 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a54f66f5-8f9a-4ef8-8f5a-29dab44acd5a tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:48.866121 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a54f66f5-8f9a-4ef8-8f5a-29dab44acd5a tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:48.866563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a54f66f5-8f9a-4ef8-8f5a-29dab44acd5a tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:48.867270 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a54f66f5-8f9a-4ef8-8f5a-29dab44acd5a tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:49.024140 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a54f66f5-8f9a-4ef8-8f5a-29dab44acd5a tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:49.032621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a54f66f5-8f9a-4ef8-8f5a-29dab44acd5a tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1519 microversion: 2.1 time: 0.178537 Aug 31 11:57:49.033207 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 665/1314] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:48 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:50.053515 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-f49fbd69-e100-4e9e-a25e-4c3a58f84072 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:50.054109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-f49fbd69-e100-4e9e-a25e-4c3a58f84072 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:50.061306 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f49fbd69-e100-4e9e-a25e-4c3a58f84072 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:50.061784 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f49fbd69-e100-4e9e-a25e-4c3a58f84072 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:50.062221 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f49fbd69-e100-4e9e-a25e-4c3a58f84072 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:50.062915 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f49fbd69-e100-4e9e-a25e-4c3a58f84072 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:50.063364 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f49fbd69-e100-4e9e-a25e-4c3a58f84072 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:50.063788 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-f49fbd69-e100-4e9e-a25e-4c3a58f84072 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:50.201034 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-f49fbd69-e100-4e9e-a25e-4c3a58f84072 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:50.209484 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-f49fbd69-e100-4e9e-a25e-4c3a58f84072 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1521 microversion: 2.1 time: 0.159797 Aug 31 11:57:50.210433 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 650/1315] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:50 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:51.179524 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-8a5378e8-c714-412c-ae00-f9d3eebac2cd req-09480b8d-14eb-4c4c-bb08-de50124c9f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae99bf4-5a13-4a75-9b1d-74322674eef7", "name": "network-vif-unplugged", "status": "completed", "tag": "ae42fa42-e307-48c8-84d2-bb9169f0531f"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:57:51.190181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-8a5378e8-c714-412c-ae00-f9d3eebac2cd req-09480b8d-14eb-4c4c-bb08-de50124c9f7e service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:51.190579 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-8a5378e8-c714-412c-ae00-f9d3eebac2cd req-09480b8d-14eb-4c4c-bb08-de50124c9f7e service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:51.191108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-8a5378e8-c714-412c-ae00-f9d3eebac2cd req-09480b8d-14eb-4c4c-bb08-de50124c9f7e service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:51.202545 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-8a5378e8-c714-412c-ae00-f9d3eebac2cd req-09480b8d-14eb-4c4c-bb08-de50124c9f7e service nova] Creating event network-vif-unplugged:ae42fa42-e307-48c8-84d2-bb9169f0531f for instance cae99bf4-5a13-4a75-9b1d-74322674eef7 on hv-cinder-83976 Aug 31 11:57:51.207534 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-8a5378e8-c714-412c-ae00-f9d3eebac2cd req-09480b8d-14eb-4c4c-bb08-de50124c9f7e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031698 Aug 31 11:57:51.208135 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 666/1316] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:57:51.231071 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-32931aec-e6ec-4b28-a901-dc294b2e3f5c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:51.231812 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-32931aec-e6ec-4b28-a901-dc294b2e3f5c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:51.239662 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-32931aec-e6ec-4b28-a901-dc294b2e3f5c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:51.240145 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-32931aec-e6ec-4b28-a901-dc294b2e3f5c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:51.240604 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-32931aec-e6ec-4b28-a901-dc294b2e3f5c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:51.241303 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-32931aec-e6ec-4b28-a901-dc294b2e3f5c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:51.241753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-32931aec-e6ec-4b28-a901-dc294b2e3f5c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:51.242173 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-32931aec-e6ec-4b28-a901-dc294b2e3f5c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:51.375971 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-32931aec-e6ec-4b28-a901-dc294b2e3f5c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:51.383623 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-32931aec-e6ec-4b28-a901-dc294b2e3f5c tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1577 microversion: 2.1 time: 0.156384 Aug 31 11:57:51.384196 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 651/1317] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:51 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:52.406515 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a24db856-737c-43d5-b438-53267b48c88b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:52.407212 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a24db856-737c-43d5-b438-53267b48c88b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:52.413479 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a24db856-737c-43d5-b438-53267b48c88b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:52.413959 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a24db856-737c-43d5-b438-53267b48c88b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:52.414389 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a24db856-737c-43d5-b438-53267b48c88b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:52.415107 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a24db856-737c-43d5-b438-53267b48c88b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:52.415561 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a24db856-737c-43d5-b438-53267b48c88b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:52.415986 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a24db856-737c-43d5-b438-53267b48c88b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:52.548058 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a24db856-737c-43d5-b438-53267b48c88b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:52.555767 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a24db856-737c-43d5-b438-53267b48c88b tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1577 microversion: 2.1 time: 0.154231 Aug 31 11:57:52.556333 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 667/1318] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:52 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:53.577573 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-142cfa57-dc11-410a-a160-f5d8b1194918 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:53.578189 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-142cfa57-dc11-410a-a160-f5d8b1194918 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:53.584605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-142cfa57-dc11-410a-a160-f5d8b1194918 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:53.585082 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-142cfa57-dc11-410a-a160-f5d8b1194918 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:53.585520 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-142cfa57-dc11-410a-a160-f5d8b1194918 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:53.586205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-142cfa57-dc11-410a-a160-f5d8b1194918 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:53.586734 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-142cfa57-dc11-410a-a160-f5d8b1194918 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:53.587154 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-142cfa57-dc11-410a-a160-f5d8b1194918 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:53.725361 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-142cfa57-dc11-410a-a160-f5d8b1194918 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:53.733595 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-142cfa57-dc11-410a-a160-f5d8b1194918 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1577 microversion: 2.1 time: 0.160001 Aug 31 11:57:53.734163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 652/1319] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:53 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:54.754179 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b08ba40b-9cf9-4f19-9685-594e9e013cd9 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:54.754741 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b08ba40b-9cf9-4f19-9685-594e9e013cd9 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:54.761276 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b08ba40b-9cf9-4f19-9685-594e9e013cd9 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:54.761749 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b08ba40b-9cf9-4f19-9685-594e9e013cd9 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:54.762181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b08ba40b-9cf9-4f19-9685-594e9e013cd9 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:54.762870 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b08ba40b-9cf9-4f19-9685-594e9e013cd9 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:54.763325 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b08ba40b-9cf9-4f19-9685-594e9e013cd9 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:54.763744 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b08ba40b-9cf9-4f19-9685-594e9e013cd9 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:54.897999 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b08ba40b-9cf9-4f19-9685-594e9e013cd9 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:54.905967 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b08ba40b-9cf9-4f19-9685-594e9e013cd9 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1577 microversion: 2.1 time: 0.155718 Aug 31 11:57:54.906544 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 668/1320] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:54 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:57:55.927529 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2e6b8d2a-6df2-49c9-b470-50c1ca29097e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:55.928122 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2e6b8d2a-6df2-49c9-b470-50c1ca29097e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:55.934506 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2e6b8d2a-6df2-49c9-b470-50c1ca29097e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:55.934981 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2e6b8d2a-6df2-49c9-b470-50c1ca29097e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:55.935411 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2e6b8d2a-6df2-49c9-b470-50c1ca29097e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:55.936102 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2e6b8d2a-6df2-49c9-b470-50c1ca29097e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:55.936564 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2e6b8d2a-6df2-49c9-b470-50c1ca29097e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:55.936981 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2e6b8d2a-6df2-49c9-b470-50c1ca29097e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:56.067623 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2e6b8d2a-6df2-49c9-b470-50c1ca29097e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:56.075383 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2e6b8d2a-6df2-49c9-b470-50c1ca29097e tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1577 microversion: 2.1 time: 0.151771 Aug 31 11:57:56.075955 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 653/1321] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:55 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:57.098055 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3e083c5c-adb1-4c41-8b48-06313609f802 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:57.098674 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3e083c5c-adb1-4c41-8b48-06313609f802 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:57.105401 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e083c5c-adb1-4c41-8b48-06313609f802 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:57.105881 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e083c5c-adb1-4c41-8b48-06313609f802 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:57.106320 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e083c5c-adb1-4c41-8b48-06313609f802 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:57.107008 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e083c5c-adb1-4c41-8b48-06313609f802 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:57.107457 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e083c5c-adb1-4c41-8b48-06313609f802 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:57.108513 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3e083c5c-adb1-4c41-8b48-06313609f802 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:57.241056 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3e083c5c-adb1-4c41-8b48-06313609f802 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:57.250281 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3e083c5c-adb1-4c41-8b48-06313609f802 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1577 microversion: 2.1 time: 0.156200 Aug 31 11:57:57.250947 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 669/1322] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:57 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:58.271582 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-83c218a5-1c6a-4f59-ae64-933737c833d8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:58.272123 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-83c218a5-1c6a-4f59-ae64-933737c833d8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:58.278599 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-83c218a5-1c6a-4f59-ae64-933737c833d8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:58.279074 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-83c218a5-1c6a-4f59-ae64-933737c833d8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:58.279502 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-83c218a5-1c6a-4f59-ae64-933737c833d8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:58.280193 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-83c218a5-1c6a-4f59-ae64-933737c833d8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:58.280690 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-83c218a5-1c6a-4f59-ae64-933737c833d8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:58.281109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-83c218a5-1c6a-4f59-ae64-933737c833d8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:58.473351 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-83c218a5-1c6a-4f59-ae64-933737c833d8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:58.481357 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-83c218a5-1c6a-4f59-ae64-933737c833d8 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1577 microversion: 2.1 time: 0.213863 Aug 31 11:57:58.481948 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 654/1323] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:58 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:57:59.503250 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ca395998-2d28-4472-9923-7f4c0d76d903 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:57:59.504109 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ca395998-2d28-4472-9923-7f4c0d76d903 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:57:59.510634 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca395998-2d28-4472-9923-7f4c0d76d903 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:59.511119 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca395998-2d28-4472-9923-7f4c0d76d903 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:59.511553 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca395998-2d28-4472-9923-7f4c0d76d903 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:59.512395 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca395998-2d28-4472-9923-7f4c0d76d903 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:57:59.512763 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca395998-2d28-4472-9923-7f4c0d76d903 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:57:59.513739 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ca395998-2d28-4472-9923-7f4c0d76d903 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:57:59.710128 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-ca395998-2d28-4472-9923-7f4c0d76d903 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:57:59.718930 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ca395998-2d28-4472-9923-7f4c0d76d903 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1564 microversion: 2.1 time: 0.220114 Aug 31 11:57:59.719976 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 670/1324] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:57:59 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1564 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:58:01.304705 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-867a5372-c6ae-4d1f-9e4d-16b21b4d42a6 req-1fc1646f-b6a0-4d80-bf6c-2ac092330fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae99bf4-5a13-4a75-9b1d-74322674eef7", "name": "network-vif-plugged", "status": "completed", "tag": "ae42fa42-e307-48c8-84d2-bb9169f0531f"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:58:01.318470 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-867a5372-c6ae-4d1f-9e4d-16b21b4d42a6 req-1fc1646f-b6a0-4d80-bf6c-2ac092330fdc service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:58:01.318947 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-867a5372-c6ae-4d1f-9e4d-16b21b4d42a6 req-1fc1646f-b6a0-4d80-bf6c-2ac092330fdc service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:58:01.319428 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-867a5372-c6ae-4d1f-9e4d-16b21b4d42a6 req-1fc1646f-b6a0-4d80-bf6c-2ac092330fdc service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:58:01.331770 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-867a5372-c6ae-4d1f-9e4d-16b21b4d42a6 req-1fc1646f-b6a0-4d80-bf6c-2ac092330fdc service nova] Creating event network-vif-plugged:ae42fa42-e307-48c8-84d2-bb9169f0531f for instance cae99bf4-5a13-4a75-9b1d-74322674eef7 on hv-cinder-83976 Aug 31 11:58:01.337777 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-867a5372-c6ae-4d1f-9e4d-16b21b4d42a6 req-1fc1646f-b6a0-4d80-bf6c-2ac092330fdc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037802 Aug 31 11:58:01.338529 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 655/1325] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:59:13.761835 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=26 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:59:13.762675 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:59:13.763936 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 11:59:13.764130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Wed Aug 31 11:59:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 (ip 10.222.0.60) !!! Aug 31 11:59:13.767369 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 31 11:59:13.775570 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-ed240d95-4c2f-4d3d-aeb5-ff9067f30425 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:13.776064 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ed240d95-4c2f-4d3d-aeb5-ff9067f30425 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:13.787086 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ed240d95-4c2f-4d3d-aeb5-ff9067f30425 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:13.787570 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ed240d95-4c2f-4d3d-aeb5-ff9067f30425 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:13.788002 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ed240d95-4c2f-4d3d-aeb5-ff9067f30425 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:13.788728 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ed240d95-4c2f-4d3d-aeb5-ff9067f30425 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:13.789175 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ed240d95-4c2f-4d3d-aeb5-ff9067f30425 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:13.789597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-ed240d95-4c2f-4d3d-aeb5-ff9067f30425 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:13.816921 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-ed240d95-4c2f-4d3d-aeb5-ff9067f30425 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Going to try to terminate instance {{(pid=127062) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:59:13.905597 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-ed240d95-4c2f-4d3d-aeb5-ff9067f30425 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 204 len: 0 microversion: 2.1 time: 0.145368 Aug 31 11:59:13.907031 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 671/1326] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:59:13 2022] DELETE /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:59:13.914404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:59:13.915294 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:59:13.916632 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 11:59:13.916852 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Wed Aug 31 11:59:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 (ip 10.222.0.60) !!! Aug 31 11:59:13.923759 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8edb338d-1f26-43f2-bec2-5af48b7cd331 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:13.924446 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8edb338d-1f26-43f2-bec2-5af48b7cd331 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:13.934383 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8edb338d-1f26-43f2-bec2-5af48b7cd331 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:13.934796 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8edb338d-1f26-43f2-bec2-5af48b7cd331 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:13.935223 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8edb338d-1f26-43f2-bec2-5af48b7cd331 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:13.935918 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8edb338d-1f26-43f2-bec2-5af48b7cd331 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:13.936383 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8edb338d-1f26-43f2-bec2-5af48b7cd331 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:13.936827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8edb338d-1f26-43f2-bec2-5af48b7cd331 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:14.086557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8edb338d-1f26-43f2-bec2-5af48b7cd331 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:14.094546 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8edb338d-1f26-43f2-bec2-5af48b7cd331 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1574 microversion: 2.1 time: 0.182139 Aug 31 11:59:14.095116 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 656/1327] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:13 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:59:15.115695 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-46be1be0-9e1b-4f5a-b266-7a9eb451b245 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:15.116421 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-46be1be0-9e1b-4f5a-b266-7a9eb451b245 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:15.122981 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-46be1be0-9e1b-4f5a-b266-7a9eb451b245 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:15.123462 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-46be1be0-9e1b-4f5a-b266-7a9eb451b245 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:15.123919 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-46be1be0-9e1b-4f5a-b266-7a9eb451b245 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:15.125144 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-46be1be0-9e1b-4f5a-b266-7a9eb451b245 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:15.125594 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-46be1be0-9e1b-4f5a-b266-7a9eb451b245 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:15.126017 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-46be1be0-9e1b-4f5a-b266-7a9eb451b245 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:15.275072 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-46be1be0-9e1b-4f5a-b266-7a9eb451b245 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:15.283108 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-46be1be0-9e1b-4f5a-b266-7a9eb451b245 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1574 microversion: 2.1 time: 0.171619 Aug 31 11:59:15.283683 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 672/1328] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:15 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:59:16.304544 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4719f0c3-f24e-4f5a-8595-1d4b84bfd83e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:16.306146 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4719f0c3-f24e-4f5a-8595-1d4b84bfd83e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:16.313419 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4719f0c3-f24e-4f5a-8595-1d4b84bfd83e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:16.314020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4719f0c3-f24e-4f5a-8595-1d4b84bfd83e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:16.314465 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4719f0c3-f24e-4f5a-8595-1d4b84bfd83e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:16.315175 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4719f0c3-f24e-4f5a-8595-1d4b84bfd83e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:16.315625 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4719f0c3-f24e-4f5a-8595-1d4b84bfd83e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:16.316057 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4719f0c3-f24e-4f5a-8595-1d4b84bfd83e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:16.412836 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4719f0c3-f24e-4f5a-8595-1d4b84bfd83e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:16.422287 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4719f0c3-f24e-4f5a-8595-1d4b84bfd83e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 200 len: 1507 microversion: 2.1 time: 0.122265 Aug 31 11:59:16.432792 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 657/1329] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:16 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 1507 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:59:16.498882 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-a541aa77-b285-4df3-b332-3e33cb5af7ab req-8ba288a4-7354-4ded-9ab5-91d17f20874e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c016285-8d0b-49ea-9722-3ec6f878f274", "name": "network-vif-deleted", "tag": "ca9a2e92-d016-480c-8ca0-64a8dc7c7119"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:59:16.511425 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-a541aa77-b285-4df3-b332-3e33cb5af7ab req-8ba288a4-7354-4ded-9ab5-91d17f20874e service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:16.511989 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-a541aa77-b285-4df3-b332-3e33cb5af7ab req-8ba288a4-7354-4ded-9ab5-91d17f20874e service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:16.512532 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-a541aa77-b285-4df3-b332-3e33cb5af7ab req-8ba288a4-7354-4ded-9ab5-91d17f20874e service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:16.544447 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-a541aa77-b285-4df3-b332-3e33cb5af7ab req-8ba288a4-7354-4ded-9ab5-91d17f20874e service nova] Creating event network-vif-deleted:ca9a2e92-d016-480c-8ca0-64a8dc7c7119 for instance 3c016285-8d0b-49ea-9722-3ec6f878f274 on hv-cinder-83976 Aug 31 11:59:16.557648 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-a541aa77-b285-4df3-b332-3e33cb5af7ab req-8ba288a4-7354-4ded-9ab5-91d17f20874e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062244 Aug 31 11:59:16.558686 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 673/1330] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:59:17.447973 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-19dbc168-c7fa-4ba1-9aa3-a72b62ef2322 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:17.448825 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-19dbc168-c7fa-4ba1-9aa3-a72b62ef2322 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:17.458873 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19dbc168-c7fa-4ba1-9aa3-a72b62ef2322 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:17.460104 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19dbc168-c7fa-4ba1-9aa3-a72b62ef2322 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:17.460104 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19dbc168-c7fa-4ba1-9aa3-a72b62ef2322 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:17.460775 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19dbc168-c7fa-4ba1-9aa3-a72b62ef2322 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:17.461514 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19dbc168-c7fa-4ba1-9aa3-a72b62ef2322 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:17.462014 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19dbc168-c7fa-4ba1-9aa3-a72b62ef2322 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:17.481104 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-19dbc168-c7fa-4ba1-9aa3-a72b62ef2322 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] HTTP exception thrown: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-19dbc168-c7fa-4ba1-9aa3-a72b62ef2322 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Request method failure captured: Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 HTTP/1.1 Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0xPTp-Y3MFRJFHKxfVTyL9rMnJSH4hjHNXzhqXB6tm8dm4AU7iM_h9a4ESswNHevMhyY6zQsWgUS5GDNCONb_OxExbxDImmRj8M9g_GexrsaYMbIXuTXfJwF55gUCA_6fKJatOU_HrjiT8j20nujvcE5PCuI2AiyV6AvZlxW-f5P60 Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: fe46592aea54410c9f49a0371bb2bc73 Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-TestVolumeBootPattern-1786440814 Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 11:59:17.485960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 11:59:17.488003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fe46592aea54410c9f49a0371bb2bc73", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fe46592aea54410c9f49a0371bb2bc73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe46592aea54410c9f49a0371bb2bc73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe46592aea54410c9f49a0371bb2bc73"}]}] Aug 31 11:59:17.488003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-TestVolumeBootPattern-1786440814 Aug 31 11:59:17.488003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: fe46592aea54410c9f49a0371bb2bc73 Aug 31 11:59:17.488003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-TestVolumeBootPattern-1786440814 Aug 31 11:59:17.488003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-TestVolumeBootPattern-1786440814-project Aug 31 11:59:17.488003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 11:59:17.488003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 11:59:17.488003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: c6d4923a511342248e34954fc44811c0 Aug 31 11:59:17.488003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-TestVolumeBootPattern-1786440814-project Aug 31 11:59:17.488003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 11:59:17.488003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. Aug 31 11:59:17.488003 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '3c016285-8d0b-49ea-9722-3ec6f878f274'} Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:59:17.489251 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. Aug 31 11:59:17.491124 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 11:59:17.492605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-19dbc168-c7fa-4ba1-9aa3-a72b62ef2322 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Returning 404 to user: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:59:17.492605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-19dbc168-c7fa-4ba1-9aa3-a72b62ef2322 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 404 len: 111 microversion: 2.1 time: 0.046061 Aug 31 11:59:17.492605 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 658/1331] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:17 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:59:17.604310 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1583835929", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-379067288", "security_groups": [{"name": "tempest-secgroup-smoke-871307451"}], "block_device_mapping_v2": [{"uuid": "27c3f748-b162-4dde-a6dc-256c3c79ac75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "87aea852-8a87-40d1-89ab-b1ccf4cde936"}]}} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:59:17.776776 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.network.neutron [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] validate_networks() for [('87aea852-8a87-40d1-89ab-b1ccf4cde936', None, None, None, None, None)] {{(pid=127062) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:59:18.188933 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Flavor limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:59:18.189409 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Image limits 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:59:18.189937 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Flavor pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:59:18.190394 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Image pref 0:0:0 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:59:18.190856 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.virt.hardware [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127062) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:59:18.199695 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:18.200175 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:18.200643 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:18.201374 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:18.201823 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:18.202245 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:18.221048 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Getting quotas for project fe46592aea54410c9f49a0371bb2bc73. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:59:18.225217 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.quota [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Getting quotas for user c6d4923a511342248e34954fc44811c0 and project fe46592aea54410c9f49a0371bb2bc73. Resources: {'ram', 'instances', 'cores'} {{(pid=127062) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:59:18.292470 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Going to run 1 instances... {{(pid=127062) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:59:18.295061 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='27c3f748-b162-4dde-a6dc-256c3c79ac75',volume_size=None,volume_type=None)] {{(pid=127062) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:59:18.433075 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f4102955-6e15-4d16-b1f2-2a9e7cce6141 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.835254 Aug 31 11:59:18.433715 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 674/1332] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 11:59:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:59:18.446017 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-db89c1e6-165e-451e-bc5e-1620af48b6d6 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:18.446543 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-db89c1e6-165e-451e-bc5e-1620af48b6d6 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:18.520229 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-db89c1e6-165e-451e-bc5e-1620af48b6d6 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:18.527466 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-db89c1e6-165e-451e-bc5e-1620af48b6d6 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1094 microversion: 2.1 time: 0.085384 Aug 31 11:59:18.528127 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 659/1333] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:18 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:59:19.549731 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cde2e6c0-92cb-4d07-a3d3-935b6f2aedfe tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:19.551013 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cde2e6c0-92cb-4d07-a3d3-935b6f2aedfe tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:19.559999 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cde2e6c0-92cb-4d07-a3d3-935b6f2aedfe tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:19.560816 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cde2e6c0-92cb-4d07-a3d3-935b6f2aedfe tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:19.561246 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cde2e6c0-92cb-4d07-a3d3-935b6f2aedfe tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:19.562284 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cde2e6c0-92cb-4d07-a3d3-935b6f2aedfe tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:19.564458 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cde2e6c0-92cb-4d07-a3d3-935b6f2aedfe tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:19.564992 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cde2e6c0-92cb-4d07-a3d3-935b6f2aedfe tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:19.901906 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cde2e6c0-92cb-4d07-a3d3-935b6f2aedfe tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:19.910614 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cde2e6c0-92cb-4d07-a3d3-935b6f2aedfe tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1200 microversion: 2.1 time: 0.365994 Aug 31 11:59:19.911200 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 675/1334] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:19 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1200 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:59:20.937242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e297039a-b647-4162-a25d-6ab633f430e5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:20.938722 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e297039a-b647-4162-a25d-6ab633f430e5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:20.946489 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e297039a-b647-4162-a25d-6ab633f430e5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:20.947059 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e297039a-b647-4162-a25d-6ab633f430e5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:20.947554 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e297039a-b647-4162-a25d-6ab633f430e5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:20.948404 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e297039a-b647-4162-a25d-6ab633f430e5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:20.948896 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e297039a-b647-4162-a25d-6ab633f430e5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:20.949387 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e297039a-b647-4162-a25d-6ab633f430e5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:21.094504 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e297039a-b647-4162-a25d-6ab633f430e5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:21.102480 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e297039a-b647-4162-a25d-6ab633f430e5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1265 microversion: 2.1 time: 0.170618 Aug 31 11:59:21.103155 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 660/1335] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:20 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:59:21.228143 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-67d0231f-2e13-4ad7-b9c6-e647cd334102 req-27698de2-278f-48ba-b0c5-641a90659e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9b95af1-7e84-496f-ad1b-fb76d9611cef", "tag": "9755e47d-a274-473e-80af-183c6e2a483a"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:59:21.239721 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-67d0231f-2e13-4ad7-b9c6-e647cd334102 req-27698de2-278f-48ba-b0c5-641a90659e98 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:21.240340 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-67d0231f-2e13-4ad7-b9c6-e647cd334102 req-27698de2-278f-48ba-b0c5-641a90659e98 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:21.240913 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-67d0231f-2e13-4ad7-b9c6-e647cd334102 req-27698de2-278f-48ba-b0c5-641a90659e98 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:21.254956 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-67d0231f-2e13-4ad7-b9c6-e647cd334102 req-27698de2-278f-48ba-b0c5-641a90659e98 service nova] Creating event network-changed:9755e47d-a274-473e-80af-183c6e2a483a for instance d9b95af1-7e84-496f-ad1b-fb76d9611cef on hv-cinder-83976 Aug 31 11:59:21.261126 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-67d0231f-2e13-4ad7-b9c6-e647cd334102 req-27698de2-278f-48ba-b0c5-641a90659e98 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036598 Aug 31 11:59:21.262140 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 676/1336] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:59:22.125011 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8d8b6825-04cd-4c0d-911a-248a3c7982ab tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:22.125621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8d8b6825-04cd-4c0d-911a-248a3c7982ab tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:22.132067 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8d8b6825-04cd-4c0d-911a-248a3c7982ab tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:22.132584 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8d8b6825-04cd-4c0d-911a-248a3c7982ab tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:22.133020 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8d8b6825-04cd-4c0d-911a-248a3c7982ab tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:22.133737 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8d8b6825-04cd-4c0d-911a-248a3c7982ab tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:22.134185 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8d8b6825-04cd-4c0d-911a-248a3c7982ab tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:22.134609 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8d8b6825-04cd-4c0d-911a-248a3c7982ab tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:22.270753 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8d8b6825-04cd-4c0d-911a-248a3c7982ab tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:22.278451 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8d8b6825-04cd-4c0d-911a-248a3c7982ab tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1265 microversion: 2.1 time: 0.157767 Aug 31 11:59:22.279078 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 661/1337] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:22 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:59:23.301680 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a1689881-bc8a-4dd1-9341-c94b3d9c4030 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:23.302380 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a1689881-bc8a-4dd1-9341-c94b3d9c4030 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:23.309417 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a1689881-bc8a-4dd1-9341-c94b3d9c4030 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:23.309906 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a1689881-bc8a-4dd1-9341-c94b3d9c4030 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:23.310341 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a1689881-bc8a-4dd1-9341-c94b3d9c4030 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:23.311453 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a1689881-bc8a-4dd1-9341-c94b3d9c4030 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:23.311453 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a1689881-bc8a-4dd1-9341-c94b3d9c4030 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:23.312022 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a1689881-bc8a-4dd1-9341-c94b3d9c4030 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:23.460466 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a1689881-bc8a-4dd1-9341-c94b3d9c4030 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:23.468849 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a1689881-bc8a-4dd1-9341-c94b3d9c4030 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1265 microversion: 2.1 time: 0.172559 Aug 31 11:59:23.469523 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 677/1338] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:23 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:59:24.490050 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-938d7852-199f-4a36-841d-172739097329 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:24.490800 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-938d7852-199f-4a36-841d-172739097329 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:24.497419 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-938d7852-199f-4a36-841d-172739097329 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:24.497892 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-938d7852-199f-4a36-841d-172739097329 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:24.498348 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-938d7852-199f-4a36-841d-172739097329 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:24.499654 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-938d7852-199f-4a36-841d-172739097329 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:24.500198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-938d7852-199f-4a36-841d-172739097329 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:24.500648 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-938d7852-199f-4a36-841d-172739097329 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:24.632902 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-938d7852-199f-4a36-841d-172739097329 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:24.642301 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-938d7852-199f-4a36-841d-172739097329 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1265 microversion: 2.1 time: 0.155960 Aug 31 11:59:24.642966 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 662/1339] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:24 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:59:25.664899 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-13366e42-7df8-4cb8-bf20-7bab7665a013 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:25.665508 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-13366e42-7df8-4cb8-bf20-7bab7665a013 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:25.673282 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-13366e42-7df8-4cb8-bf20-7bab7665a013 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:25.673771 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-13366e42-7df8-4cb8-bf20-7bab7665a013 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:25.674206 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-13366e42-7df8-4cb8-bf20-7bab7665a013 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:25.674910 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-13366e42-7df8-4cb8-bf20-7bab7665a013 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:25.675362 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-13366e42-7df8-4cb8-bf20-7bab7665a013 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:25.675787 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-13366e42-7df8-4cb8-bf20-7bab7665a013 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:25.808777 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-13366e42-7df8-4cb8-bf20-7bab7665a013 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:25.817135 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-13366e42-7df8-4cb8-bf20-7bab7665a013 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1265 microversion: 2.1 time: 0.156107 Aug 31 11:59:25.817708 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 678/1340] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:25 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:59:26.837964 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3857fa0c-853a-4b23-88fc-d4e38ea24d71 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:26.838571 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3857fa0c-853a-4b23-88fc-d4e38ea24d71 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:26.845261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3857fa0c-853a-4b23-88fc-d4e38ea24d71 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:26.845741 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3857fa0c-853a-4b23-88fc-d4e38ea24d71 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:26.846171 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3857fa0c-853a-4b23-88fc-d4e38ea24d71 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:26.846884 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3857fa0c-853a-4b23-88fc-d4e38ea24d71 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:26.847322 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3857fa0c-853a-4b23-88fc-d4e38ea24d71 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:26.847738 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3857fa0c-853a-4b23-88fc-d4e38ea24d71 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:27.001653 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3857fa0c-853a-4b23-88fc-d4e38ea24d71 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:27.009867 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3857fa0c-853a-4b23-88fc-d4e38ea24d71 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1265 microversion: 2.1 time: 0.175595 Aug 31 11:59:27.010918 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 663/1341] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:26 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:59:27.734051 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b30b2b5a-f27a-4c9e-bc8a-6e16efd2d5f2 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:27.734690 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b30b2b5a-f27a-4c9e-bc8a-6e16efd2d5f2 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:27.744187 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b30b2b5a-f27a-4c9e-bc8a-6e16efd2d5f2 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:27.744759 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b30b2b5a-f27a-4c9e-bc8a-6e16efd2d5f2 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:27.745424 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b30b2b5a-f27a-4c9e-bc8a-6e16efd2d5f2 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:27.746395 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b30b2b5a-f27a-4c9e-bc8a-6e16efd2d5f2 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:27.747069 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b30b2b5a-f27a-4c9e-bc8a-6e16efd2d5f2 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:27.747698 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b30b2b5a-f27a-4c9e-bc8a-6e16efd2d5f2 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:27.783456 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b30b2b5a-f27a-4c9e-bc8a-6e16efd2d5f2 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Going to try to terminate instance {{(pid=127062) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:59:27.823745 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-43f3bd19-3ea0-4149-adf7-1b9f900446dc req-c0612a8a-e848-423b-a989-80e6e0649ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae99bf4-5a13-4a75-9b1d-74322674eef7", "tag": "ae42fa42-e307-48c8-84d2-bb9169f0531f"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:59:27.840624 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-43f3bd19-3ea0-4149-adf7-1b9f900446dc req-c0612a8a-e848-423b-a989-80e6e0649ffd service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:27.842084 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-43f3bd19-3ea0-4149-adf7-1b9f900446dc req-c0612a8a-e848-423b-a989-80e6e0649ffd service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:27.842854 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-43f3bd19-3ea0-4149-adf7-1b9f900446dc req-c0612a8a-e848-423b-a989-80e6e0649ffd service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:27.856152 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-43f3bd19-3ea0-4149-adf7-1b9f900446dc req-c0612a8a-e848-423b-a989-80e6e0649ffd service nova] Creating event network-changed:ae42fa42-e307-48c8-84d2-bb9169f0531f for instance cae99bf4-5a13-4a75-9b1d-74322674eef7 on hv-cinder-83976 Aug 31 11:59:27.864526 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-43f3bd19-3ea0-4149-adf7-1b9f900446dc req-c0612a8a-e848-423b-a989-80e6e0649ffd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133276 Aug 31 11:59:27.865860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 664/1342] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:59:27.887160 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b30b2b5a-f27a-4c9e-bc8a-6e16efd2d5f2 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 204 len: 0 microversion: 2.1 time: 0.158881 Aug 31 11:59:27.887755 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 679/1343] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 11:59:27 2022] DELETE /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:59:27.897847 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8055321d-ca39-4cf4-a446-c3e1a48da3a3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:27.898575 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8055321d-ca39-4cf4-a446-c3e1a48da3a3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:27.905473 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8055321d-ca39-4cf4-a446-c3e1a48da3a3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:27.906090 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8055321d-ca39-4cf4-a446-c3e1a48da3a3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:27.906588 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8055321d-ca39-4cf4-a446-c3e1a48da3a3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:27.907322 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8055321d-ca39-4cf4-a446-c3e1a48da3a3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:27.907777 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8055321d-ca39-4cf4-a446-c3e1a48da3a3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:27.908203 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8055321d-ca39-4cf4-a446-c3e1a48da3a3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:28.032099 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-fe3c8c0b-ae24-4b05-9ba4-15f2d29c29d3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:28.032855 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-fe3c8c0b-ae24-4b05-9ba4-15f2d29c29d3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:28.039540 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe3c8c0b-ae24-4b05-9ba4-15f2d29c29d3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:28.040663 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe3c8c0b-ae24-4b05-9ba4-15f2d29c29d3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:28.041793 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe3c8c0b-ae24-4b05-9ba4-15f2d29c29d3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:28.042773 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe3c8c0b-ae24-4b05-9ba4-15f2d29c29d3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:28.043458 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe3c8c0b-ae24-4b05-9ba4-15f2d29c29d3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:28.044110 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fe3c8c0b-ae24-4b05-9ba4-15f2d29c29d3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:28.052686 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8055321d-ca39-4cf4-a446-c3e1a48da3a3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:28.067045 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8055321d-ca39-4cf4-a446-c3e1a48da3a3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1570 microversion: 2.1 time: 0.173569 Aug 31 11:59:28.080733 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 665/1344] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:27 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:59:28.211995 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-fe3c8c0b-ae24-4b05-9ba4-15f2d29c29d3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:28.214896 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:59:28.222655 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-fe3c8c0b-ae24-4b05-9ba4-15f2d29c29d3 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1265 microversion: 2.1 time: 0.195024 Aug 31 11:59:28.223351 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 680/1345] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:28 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:59:29.089612 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-fb39cb2d-3664-462a-a8ea-ae773cde5205 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:29.090231 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-fb39cb2d-3664-462a-a8ea-ae773cde5205 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:29.092154 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:59:29.098827 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fb39cb2d-3664-462a-a8ea-ae773cde5205 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:29.099308 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fb39cb2d-3664-462a-a8ea-ae773cde5205 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:29.099741 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fb39cb2d-3664-462a-a8ea-ae773cde5205 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:29.100432 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fb39cb2d-3664-462a-a8ea-ae773cde5205 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:29.100902 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fb39cb2d-3664-462a-a8ea-ae773cde5205 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:29.101327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-fb39cb2d-3664-462a-a8ea-ae773cde5205 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:29.235943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-fb39cb2d-3664-462a-a8ea-ae773cde5205 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:29.243934 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-fb39cb2d-3664-462a-a8ea-ae773cde5205 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1570 microversion: 2.1 time: 0.158182 Aug 31 11:59:29.244516 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 666/1346] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:29 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:59:29.245999 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-86dade0d-0612-45cc-964c-114a323dcc4b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:29.246610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-86dade0d-0612-45cc-964c-114a323dcc4b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:29.248648 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=6 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:59:29.255157 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-86dade0d-0612-45cc-964c-114a323dcc4b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:29.255639 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-86dade0d-0612-45cc-964c-114a323dcc4b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:29.256076 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-86dade0d-0612-45cc-964c-114a323dcc4b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:29.256794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-86dade0d-0612-45cc-964c-114a323dcc4b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:29.257248 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-86dade0d-0612-45cc-964c-114a323dcc4b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:29.257673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-86dade0d-0612-45cc-964c-114a323dcc4b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:29.471627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-86dade0d-0612-45cc-964c-114a323dcc4b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:29.479346 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-86dade0d-0612-45cc-964c-114a323dcc4b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1265 microversion: 2.1 time: 0.237679 Aug 31 11:59:29.479940 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 681/1347] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:29 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:59:30.267319 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-19e54538-2b54-4efa-96cf-f93b77fee074 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:30.267916 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-19e54538-2b54-4efa-96cf-f93b77fee074 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:30.274554 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19e54538-2b54-4efa-96cf-f93b77fee074 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:30.275261 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19e54538-2b54-4efa-96cf-f93b77fee074 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:30.275696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19e54538-2b54-4efa-96cf-f93b77fee074 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:30.276389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19e54538-2b54-4efa-96cf-f93b77fee074 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:30.276951 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19e54538-2b54-4efa-96cf-f93b77fee074 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:30.277593 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-19e54538-2b54-4efa-96cf-f93b77fee074 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:30.378233 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-19e54538-2b54-4efa-96cf-f93b77fee074 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5cf28697ff04a3ebd70b780c10dd830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfb480658dd40f1a1f0fd5c627e843c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:30.378724 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-48c045a0-252b-40b7-8282-077c4444453e req-4d92ee3b-a95a-4cb2-962d-f861aafeb8df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae99bf4-5a13-4a75-9b1d-74322674eef7", "name": "network-vif-deleted", "tag": "ae42fa42-e307-48c8-84d2-bb9169f0531f"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:59:30.390137 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-19e54538-2b54-4efa-96cf-f93b77fee074 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 200 len: 1383 microversion: 2.1 time: 0.127736 Aug 31 11:59:30.391029 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 667/1348] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:30 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 1383 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:59:30.392265 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-48c045a0-252b-40b7-8282-077c4444453e req-4d92ee3b-a95a-4cb2-962d-f861aafeb8df service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:30.393285 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-48c045a0-252b-40b7-8282-077c4444453e req-4d92ee3b-a95a-4cb2-962d-f861aafeb8df service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:30.393952 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-48c045a0-252b-40b7-8282-077c4444453e req-4d92ee3b-a95a-4cb2-962d-f861aafeb8df service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:30.406468 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-48c045a0-252b-40b7-8282-077c4444453e req-4d92ee3b-a95a-4cb2-962d-f861aafeb8df service nova] Creating event network-vif-deleted:ae42fa42-e307-48c8-84d2-bb9169f0531f for instance cae99bf4-5a13-4a75-9b1d-74322674eef7 on hv-cinder-83976 Aug 31 11:59:30.411962 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-48c045a0-252b-40b7-8282-077c4444453e req-4d92ee3b-a95a-4cb2-962d-f861aafeb8df service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039257 Aug 31 11:59:30.412697 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 682/1349] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:59:30.502108 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-5b29f5ed-f4e6-42f5-88b3-e225a48a9d3c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:30.502775 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-5b29f5ed-f4e6-42f5-88b3-e225a48a9d3c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:30.508815 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5b29f5ed-f4e6-42f5-88b3-e225a48a9d3c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:30.509308 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5b29f5ed-f4e6-42f5-88b3-e225a48a9d3c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:30.509743 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5b29f5ed-f4e6-42f5-88b3-e225a48a9d3c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:30.510469 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5b29f5ed-f4e6-42f5-88b3-e225a48a9d3c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:30.511472 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5b29f5ed-f4e6-42f5-88b3-e225a48a9d3c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:30.511472 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-5b29f5ed-f4e6-42f5-88b3-e225a48a9d3c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:30.657155 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-5b29f5ed-f4e6-42f5-88b3-e225a48a9d3c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:30.665807 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-5b29f5ed-f4e6-42f5-88b3-e225a48a9d3c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1265 microversion: 2.1 time: 0.169301 Aug 31 11:59:30.668901 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 668/1350] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:30 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:59:31.410890 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7df6a3b4-28a2-48cf-81d5-b6e074c962d6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:31.411593 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-7df6a3b4-28a2-48cf-81d5-b6e074c962d6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] [instance: cae99bf4-5a13-4a75-9b1d-74322674eef7] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:31.418313 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7df6a3b4-28a2-48cf-81d5-b6e074c962d6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:31.418794 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7df6a3b4-28a2-48cf-81d5-b6e074c962d6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:31.419229 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7df6a3b4-28a2-48cf-81d5-b6e074c962d6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:31.419918 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7df6a3b4-28a2-48cf-81d5-b6e074c962d6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:31.420369 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7df6a3b4-28a2-48cf-81d5-b6e074c962d6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:31.421452 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-7df6a3b4-28a2-48cf-81d5-b6e074c962d6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:31.434713 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-7df6a3b4-28a2-48cf-81d5-b6e074c962d6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] HTTP exception thrown: Instance cae99bf4-5a13-4a75-9b1d-74322674eef7 could not be found. Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7df6a3b4-28a2-48cf-81d5-b6e074c962d6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Request method failure captured: Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 HTTP/1.1 Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0vP0LiXl84VEtyqp92eu9klyAte1nIteGJIwr4X8Th9rthJkl4zyYAGO9IGiGT0MVPgHq1Sdp7ROhdl0IB7H4sQGOxEerT4WmKMFneAtoZ3Rn1u5335kSqAnJ_F2r5PiowNeeHFtSP-Uq60r0N3a5IHuv5LfcwZGEtXLCRPJhd38XU Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: 2cfb480658dd40f1a1f0fd5c627e843c Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-TestShelveInstance-837199417 Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 11:59:31.437172 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 11:59:31.441292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2cfb480658dd40f1a1f0fd5c627e843c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2cfb480658dd40f1a1f0fd5c627e843c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2cfb480658dd40f1a1f0fd5c627e843c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2cfb480658dd40f1a1f0fd5c627e843c"}]}] Aug 31 11:59:31.441292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-TestShelveInstance-837199417 Aug 31 11:59:31.441292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: 2cfb480658dd40f1a1f0fd5c627e843c Aug 31 11:59:31.441292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-TestShelveInstance-837199417 Aug 31 11:59:31.441292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-TestShelveInstance-837199417-project Aug 31 11:59:31.441292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 11:59:31.441292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 11:59:31.441292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: b5cf28697ff04a3ebd70b780c10dd830 Aug 31 11:59:31.441292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-TestShelveInstance-837199417-project Aug 31 11:59:31.441292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 11:59:31.441292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance cae99bf4-5a13-4a75-9b1d-74322674eef7 could not be found. Aug 31 11:59:31.441292 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': 'cae99bf4-5a13-4a75-9b1d-74322674eef7'} Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cae99bf4-5a13-4a75-9b1d-74322674eef7 could not be found. Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:59:31.443368 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae99bf4-5a13-4a75-9b1d-74322674eef7 could not be found. Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae99bf4-5a13-4a75-9b1d-74322674eef7 could not be found. Aug 31 11:59:31.447610 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 11:59:31.449840 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-7df6a3b4-28a2-48cf-81d5-b6e074c962d6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Returning 404 to user: Instance cae99bf4-5a13-4a75-9b1d-74322674eef7 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:59:31.449840 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-7df6a3b4-28a2-48cf-81d5-b6e074c962d6 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7" status: 404 len: 111 microversion: 2.1 time: 0.032346 Aug 31 11:59:31.449840 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 683/1351] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:31 2022] GET /compute/v2.1/servers/cae99bf4-5a13-4a75-9b1d-74322674eef7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:59:31.601389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-ce540805-7a2f-464a-9114-ed197a5590f3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] Calling method '.version_select at 0x7f1734b88e50>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:31.624904 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-ce540805-7a2f-464a-9114-ed197a5590f3 tempest-TestShelveInstance-837199417 tempest-TestShelveInstance-837199417-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1087282435" status: 202 len: 0 microversion: 2.1 time: 0.027280 Aug 31 11:59:31.625557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 669/1352] 10.222.0.60 () {58 vars in 1254 bytes} [Wed Aug 31 11:59:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1087282435 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:59:31.687397 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-cc2e12a6-5d95-4b7d-af19-9a5e478b274c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:31.688328 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-cc2e12a6-5d95-4b7d-af19-9a5e478b274c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:31.694367 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc2e12a6-5d95-4b7d-af19-9a5e478b274c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:31.694832 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc2e12a6-5d95-4b7d-af19-9a5e478b274c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:31.695265 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc2e12a6-5d95-4b7d-af19-9a5e478b274c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:31.696200 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc2e12a6-5d95-4b7d-af19-9a5e478b274c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:31.696404 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc2e12a6-5d95-4b7d-af19-9a5e478b274c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:31.696851 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-cc2e12a6-5d95-4b7d-af19-9a5e478b274c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:31.909719 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-544c4808-7a89-4346-9014-6593a2f56e56 req-1d5de941-a865-4495-afe0-c2e2f02123d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b95af1-7e84-496f-ad1b-fb76d9611cef", "name": "network-vif-plugged", "status": "completed", "tag": "9755e47d-a274-473e-80af-183c6e2a483a"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:59:31.927459 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-544c4808-7a89-4346-9014-6593a2f56e56 req-1d5de941-a865-4495-afe0-c2e2f02123d8 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:31.928109 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-544c4808-7a89-4346-9014-6593a2f56e56 req-1d5de941-a865-4495-afe0-c2e2f02123d8 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:31.928777 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-544c4808-7a89-4346-9014-6593a2f56e56 req-1d5de941-a865-4495-afe0-c2e2f02123d8 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:31.941740 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-544c4808-7a89-4346-9014-6593a2f56e56 req-1d5de941-a865-4495-afe0-c2e2f02123d8 service nova] Creating event network-vif-plugged:9755e47d-a274-473e-80af-183c6e2a483a for instance d9b95af1-7e84-496f-ad1b-fb76d9611cef on hv-cinder-83976 Aug 31 11:59:31.947877 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-544c4808-7a89-4346-9014-6593a2f56e56 req-1d5de941-a865-4495-afe0-c2e2f02123d8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043988 Aug 31 11:59:31.948603 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 670/1353] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:59:31.979968 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-cc2e12a6-5d95-4b7d-af19-9a5e478b274c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:31.991094 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-cc2e12a6-5d95-4b7d-af19-9a5e478b274c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1265 microversion: 2.1 time: 0.307468 Aug 31 11:59:31.992631 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 684/1354] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:31 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:59:33.012414 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8ee99dd2-1fa9-4b55-9d4f-6417028bbd8e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:33.013159 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8ee99dd2-1fa9-4b55-9d4f-6417028bbd8e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:33.020897 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8ee99dd2-1fa9-4b55-9d4f-6417028bbd8e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:33.021399 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8ee99dd2-1fa9-4b55-9d4f-6417028bbd8e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:33.021869 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8ee99dd2-1fa9-4b55-9d4f-6417028bbd8e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:33.022612 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8ee99dd2-1fa9-4b55-9d4f-6417028bbd8e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:33.023073 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8ee99dd2-1fa9-4b55-9d4f-6417028bbd8e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:33.023721 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8ee99dd2-1fa9-4b55-9d4f-6417028bbd8e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:33.195681 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-8ee99dd2-1fa9-4b55-9d4f-6417028bbd8e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:33.205040 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8ee99dd2-1fa9-4b55-9d4f-6417028bbd8e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1265 microversion: 2.1 time: 0.196978 Aug 31 11:59:33.205613 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 671/1355] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:33 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:59:34.226662 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b22e9eb9-79b3-48d0-a542-188c9fd1f434 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:34.227307 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b22e9eb9-79b3-48d0-a542-188c9fd1f434 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:34.234309 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b22e9eb9-79b3-48d0-a542-188c9fd1f434 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:34.234784 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b22e9eb9-79b3-48d0-a542-188c9fd1f434 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:34.235222 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b22e9eb9-79b3-48d0-a542-188c9fd1f434 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:34.235909 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b22e9eb9-79b3-48d0-a542-188c9fd1f434 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:34.236356 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b22e9eb9-79b3-48d0-a542-188c9fd1f434 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:34.236803 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b22e9eb9-79b3-48d0-a542-188c9fd1f434 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:34.388246 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-b22e9eb9-79b3-48d0-a542-188c9fd1f434 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:34.397243 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b22e9eb9-79b3-48d0-a542-188c9fd1f434 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1451 microversion: 2.1 time: 0.174351 Aug 31 11:59:34.398925 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 685/1356] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:34 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:59:34.418640 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3a4c0103-18f0-4bba-b94f-29ea40aa2486 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:59:34.419487 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3a4c0103-18f0-4bba-b94f-29ea40aa2486 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:59:34.428904 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a4c0103-18f0-4bba-b94f-29ea40aa2486 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:34.429609 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a4c0103-18f0-4bba-b94f-29ea40aa2486 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:34.430110 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a4c0103-18f0-4bba-b94f-29ea40aa2486 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:34.430881 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a4c0103-18f0-4bba-b94f-29ea40aa2486 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:34.431389 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a4c0103-18f0-4bba-b94f-29ea40aa2486 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:34.432378 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3a4c0103-18f0-4bba-b94f-29ea40aa2486 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:34.653868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3a4c0103-18f0-4bba-b94f-29ea40aa2486 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:59:34.662630 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3a4c0103-18f0-4bba-b94f-29ea40aa2486 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1451 microversion: 2.1 time: 0.248178 Aug 31 11:59:34.663663 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 672/1357] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 11:59:34 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1451 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:59:37.537180 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-3206dc61-22e1-4494-9e5a-21d7f53c9660 req-f4b1a7ee-8b9f-4fa8-bbac-a135549e5801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9b95af1-7e84-496f-ad1b-fb76d9611cef", "tag": "9755e47d-a274-473e-80af-183c6e2a483a"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:59:37.548298 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-3206dc61-22e1-4494-9e5a-21d7f53c9660 req-f4b1a7ee-8b9f-4fa8-bbac-a135549e5801 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:59:37.548950 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-3206dc61-22e1-4494-9e5a-21d7f53c9660 req-f4b1a7ee-8b9f-4fa8-bbac-a135549e5801 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:59:37.549479 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-3206dc61-22e1-4494-9e5a-21d7f53c9660 req-f4b1a7ee-8b9f-4fa8-bbac-a135549e5801 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:59:37.562434 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-3206dc61-22e1-4494-9e5a-21d7f53c9660 req-f4b1a7ee-8b9f-4fa8-bbac-a135549e5801 service nova] Creating event network-changed:9755e47d-a274-473e-80af-183c6e2a483a for instance d9b95af1-7e84-496f-ad1b-fb76d9611cef on hv-cinder-83976 Aug 31 11:59:37.567920 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-3206dc61-22e1-4494-9e5a-21d7f53c9660 req-f4b1a7ee-8b9f-4fa8-bbac-a135549e5801 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034439 Aug 31 11:59:37.569252 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 686/1358] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 11:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:01:38.077211 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-635860897", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-379067288", "security_groups": [{"name": "tempest-secgroup-smoke-871307451"}], "block_device_mapping_v2": [{"uuid": "d9000f32-ec32-46e4-a52e-0cbd8f47f209", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "87aea852-8a87-40d1-89ab-b1ccf4cde936"}]}} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:01:38.087366 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:01:38.088064 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=78 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:01:38.089397 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:01:38.089546 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Wed Aug 31 12:01:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Aug 31 12:01:38.208768 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.network.neutron [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] validate_networks() for [('87aea852-8a87-40d1-89ab-b1ccf4cde936', None, None, None, None, None)] {{(pid=127061) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 12:01:38.644696 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Flavor limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 12:01:38.645103 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Image limits 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 12:01:38.645575 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Flavor pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 12:01:38.645985 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Image pref 0:0:0 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 12:01:38.646412 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.virt.hardware [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127061) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 12:01:38.655533 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:38.656009 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:38.656475 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:38.657241 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:38.657722 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:38.658147 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:38.675934 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Getting quotas for project fe46592aea54410c9f49a0371bb2bc73. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 12:01:38.680648 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.quota [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Getting quotas for user c6d4923a511342248e34954fc44811c0 and project fe46592aea54410c9f49a0371bb2bc73. Resources: {'ram', 'instances', 'cores'} {{(pid=127061) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 12:01:38.752664 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Going to run 1 instances... {{(pid=127061) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 12:01:38.754844 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d9000f32-ec32-46e4-a52e-0cbd8f47f209',volume_size=None,volume_type=None)] {{(pid=127061) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 12:01:38.899092 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-041ef81d-adf3-48fb-8064-6b35d692f46b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.826873 Aug 31 12:01:38.899638 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 673/1359] 10.222.0.60 () {60 vars in 1147 bytes} [Wed Aug 31 12:01:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 12:01:38.908998 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:01:38.910570 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:01:38.911970 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 12:01:38.912211 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Wed Aug 31 12:01:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 (ip 10.222.0.60) !!! Aug 31 12:01:38.919323 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-459356e3-dda4-4dcd-b0b5-5d4d065e57bb tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:38.920004 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-459356e3-dda4-4dcd-b0b5-5d4d065e57bb tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:38.983813 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-459356e3-dda4-4dcd-b0b5-5d4d065e57bb tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:38.991068 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-459356e3-dda4-4dcd-b0b5-5d4d065e57bb tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1093 microversion: 2.1 time: 0.083976 Aug 31 12:01:38.991548 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 687/1360] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:38 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1093 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:40.013373 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-bf84ee8f-5ebf-4977-a710-a730cf3eb91f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:40.013985 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-bf84ee8f-5ebf-4977-a710-a730cf3eb91f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:40.021958 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bf84ee8f-5ebf-4977-a710-a730cf3eb91f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:40.022440 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bf84ee8f-5ebf-4977-a710-a730cf3eb91f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:40.022868 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bf84ee8f-5ebf-4977-a710-a730cf3eb91f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:40.023557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bf84ee8f-5ebf-4977-a710-a730cf3eb91f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:40.024001 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bf84ee8f-5ebf-4977-a710-a730cf3eb91f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:40.024446 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-bf84ee8f-5ebf-4977-a710-a730cf3eb91f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:40.095027 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-bf84ee8f-5ebf-4977-a710-a730cf3eb91f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:40.104417 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-bf84ee8f-5ebf-4977-a710-a730cf3eb91f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1199 microversion: 2.1 time: 0.096756 Aug 31 12:01:40.106382 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 674/1361] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:40 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1199 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:41.127623 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-678ec05c-8717-4829-9819-a824a0b03b6d tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:41.128234 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-678ec05c-8717-4829-9819-a824a0b03b6d tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:41.139271 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-678ec05c-8717-4829-9819-a824a0b03b6d tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:41.139393 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-678ec05c-8717-4829-9819-a824a0b03b6d tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:41.139788 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-678ec05c-8717-4829-9819-a824a0b03b6d tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:41.140516 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-678ec05c-8717-4829-9819-a824a0b03b6d tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:41.140987 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-678ec05c-8717-4829-9819-a824a0b03b6d tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:41.141415 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-678ec05c-8717-4829-9819-a824a0b03b6d tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:41.287910 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-678ec05c-8717-4829-9819-a824a0b03b6d tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:41.295647 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-678ec05c-8717-4829-9819-a824a0b03b6d tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1264 microversion: 2.1 time: 0.171869 Aug 31 12:01:41.296217 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 688/1362] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:41 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:41.391436 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-581d1698-c9bd-41ee-ae08-c91e96a6af83 req-ba126e35-83be-4224-a649-e0959ea98a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e12793d0-9498-496d-87b9-a216a2b2ff21", "tag": "47d35fa1-7be5-46c9-8296-5e1d48633480"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:01:41.401995 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-581d1698-c9bd-41ee-ae08-c91e96a6af83 req-ba126e35-83be-4224-a649-e0959ea98a55 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:41.402470 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-581d1698-c9bd-41ee-ae08-c91e96a6af83 req-ba126e35-83be-4224-a649-e0959ea98a55 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:41.402899 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-581d1698-c9bd-41ee-ae08-c91e96a6af83 req-ba126e35-83be-4224-a649-e0959ea98a55 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:41.414879 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-581d1698-c9bd-41ee-ae08-c91e96a6af83 req-ba126e35-83be-4224-a649-e0959ea98a55 service nova] Creating event network-changed:47d35fa1-7be5-46c9-8296-5e1d48633480 for instance e12793d0-9498-496d-87b9-a216a2b2ff21 on hv-cinder-83976 Aug 31 12:01:41.420002 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-581d1698-c9bd-41ee-ae08-c91e96a6af83 req-ba126e35-83be-4224-a649-e0959ea98a55 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034772 Aug 31 12:01:41.420825 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 675/1363] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 12:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:01:42.317448 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f0833cf0-0305-477d-99aa-be945b48fa30 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:42.318168 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f0833cf0-0305-477d-99aa-be945b48fa30 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:42.325253 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f0833cf0-0305-477d-99aa-be945b48fa30 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:42.325740 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f0833cf0-0305-477d-99aa-be945b48fa30 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:42.326167 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f0833cf0-0305-477d-99aa-be945b48fa30 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:42.326869 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f0833cf0-0305-477d-99aa-be945b48fa30 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:42.327313 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f0833cf0-0305-477d-99aa-be945b48fa30 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:42.327732 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f0833cf0-0305-477d-99aa-be945b48fa30 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:42.711236 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f0833cf0-0305-477d-99aa-be945b48fa30 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:42.719117 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f0833cf0-0305-477d-99aa-be945b48fa30 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1264 microversion: 2.1 time: 0.405586 Aug 31 12:01:42.719692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 689/1364] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:42 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1264 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:43.740370 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3d4903c5-224a-4c1f-9f61-c7c6581757e4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:43.741099 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3d4903c5-224a-4c1f-9f61-c7c6581757e4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:43.747860 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3d4903c5-224a-4c1f-9f61-c7c6581757e4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:43.748352 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3d4903c5-224a-4c1f-9f61-c7c6581757e4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:43.748814 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3d4903c5-224a-4c1f-9f61-c7c6581757e4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:43.749504 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3d4903c5-224a-4c1f-9f61-c7c6581757e4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:43.749963 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3d4903c5-224a-4c1f-9f61-c7c6581757e4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:43.750388 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3d4903c5-224a-4c1f-9f61-c7c6581757e4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:43.883353 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-3d4903c5-224a-4c1f-9f61-c7c6581757e4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:43.892148 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3d4903c5-224a-4c1f-9f61-c7c6581757e4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1264 microversion: 2.1 time: 0.156436 Aug 31 12:01:43.892929 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 676/1365] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:43 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:44.914098 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-f0906399-a6cb-4c7a-9ea8-82af80f2bd0f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:44.914700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-f0906399-a6cb-4c7a-9ea8-82af80f2bd0f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:44.922088 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f0906399-a6cb-4c7a-9ea8-82af80f2bd0f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:44.922569 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f0906399-a6cb-4c7a-9ea8-82af80f2bd0f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:44.922994 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f0906399-a6cb-4c7a-9ea8-82af80f2bd0f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:44.923700 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f0906399-a6cb-4c7a-9ea8-82af80f2bd0f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:44.924145 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f0906399-a6cb-4c7a-9ea8-82af80f2bd0f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:44.924592 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-f0906399-a6cb-4c7a-9ea8-82af80f2bd0f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:45.066983 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-f0906399-a6cb-4c7a-9ea8-82af80f2bd0f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:45.075846 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-f0906399-a6cb-4c7a-9ea8-82af80f2bd0f tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1264 microversion: 2.1 time: 0.165511 Aug 31 12:01:45.076435 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 690/1366] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:44 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:46.099123 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-37be0a84-407d-48fa-9876-aec9b58c17bc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:46.099736 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-37be0a84-407d-48fa-9876-aec9b58c17bc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:46.106456 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-37be0a84-407d-48fa-9876-aec9b58c17bc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:46.106928 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-37be0a84-407d-48fa-9876-aec9b58c17bc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:46.107390 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-37be0a84-407d-48fa-9876-aec9b58c17bc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:46.108106 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-37be0a84-407d-48fa-9876-aec9b58c17bc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:46.108525 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-37be0a84-407d-48fa-9876-aec9b58c17bc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:46.108951 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-37be0a84-407d-48fa-9876-aec9b58c17bc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:46.246740 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-37be0a84-407d-48fa-9876-aec9b58c17bc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:46.254755 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-37be0a84-407d-48fa-9876-aec9b58c17bc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1264 microversion: 2.1 time: 0.159472 Aug 31 12:01:46.255655 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 677/1367] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:46 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:47.275301 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5dc45c46-48af-44fd-b2d0-89b0f41546aa tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:47.275906 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5dc45c46-48af-44fd-b2d0-89b0f41546aa tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:47.282621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5dc45c46-48af-44fd-b2d0-89b0f41546aa tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:47.283098 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5dc45c46-48af-44fd-b2d0-89b0f41546aa tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:47.283523 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5dc45c46-48af-44fd-b2d0-89b0f41546aa tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:47.284199 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5dc45c46-48af-44fd-b2d0-89b0f41546aa tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:47.284668 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5dc45c46-48af-44fd-b2d0-89b0f41546aa tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:47.285084 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5dc45c46-48af-44fd-b2d0-89b0f41546aa tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:47.435619 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-5dc45c46-48af-44fd-b2d0-89b0f41546aa tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:47.447116 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5dc45c46-48af-44fd-b2d0-89b0f41546aa tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1264 microversion: 2.1 time: 0.175414 Aug 31 12:01:47.447957 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 691/1368] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:47 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:48.475352 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-aa12af82-e01e-4b22-97cb-a3cfd829fcdc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:48.476237 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-aa12af82-e01e-4b22-97cb-a3cfd829fcdc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:48.484738 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aa12af82-e01e-4b22-97cb-a3cfd829fcdc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:48.485226 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aa12af82-e01e-4b22-97cb-a3cfd829fcdc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:48.485658 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aa12af82-e01e-4b22-97cb-a3cfd829fcdc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:48.486355 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aa12af82-e01e-4b22-97cb-a3cfd829fcdc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:48.486802 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aa12af82-e01e-4b22-97cb-a3cfd829fcdc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:48.487228 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aa12af82-e01e-4b22-97cb-a3cfd829fcdc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:48.647971 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-aa12af82-e01e-4b22-97cb-a3cfd829fcdc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:48.656899 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-aa12af82-e01e-4b22-97cb-a3cfd829fcdc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1264 microversion: 2.1 time: 0.187350 Aug 31 12:01:48.657554 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 678/1369] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:48 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:49.689852 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3de039eb-bdd5-46dc-9f9c-898e94320d61 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:49.690837 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3de039eb-bdd5-46dc-9f9c-898e94320d61 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:49.694179 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell0:SELECT=2 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:01:49.701437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3de039eb-bdd5-46dc-9f9c-898e94320d61 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:49.701961 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3de039eb-bdd5-46dc-9f9c-898e94320d61 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:49.702452 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3de039eb-bdd5-46dc-9f9c-898e94320d61 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:49.703166 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3de039eb-bdd5-46dc-9f9c-898e94320d61 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:49.703650 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3de039eb-bdd5-46dc-9f9c-898e94320d61 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:49.704104 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3de039eb-bdd5-46dc-9f9c-898e94320d61 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:49.889962 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-3de039eb-bdd5-46dc-9f9c-898e94320d61 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:49.902483 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3de039eb-bdd5-46dc-9f9c-898e94320d61 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1264 microversion: 2.1 time: 0.218935 Aug 31 12:01:49.903382 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 692/1370] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:49 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1264 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:50.934266 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2b646567-0da0-4114-98ae-3bed16f57bc5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:50.935283 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2b646567-0da0-4114-98ae-3bed16f57bc5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:50.938076 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=2 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:01:50.938836 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell0:SELECT=6 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:01:50.945621 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b646567-0da0-4114-98ae-3bed16f57bc5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:50.946095 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b646567-0da0-4114-98ae-3bed16f57bc5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:50.946518 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b646567-0da0-4114-98ae-3bed16f57bc5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:50.947204 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b646567-0da0-4114-98ae-3bed16f57bc5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:50.947647 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b646567-0da0-4114-98ae-3bed16f57bc5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:50.948105 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b646567-0da0-4114-98ae-3bed16f57bc5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:51.090128 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2b646567-0da0-4114-98ae-3bed16f57bc5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:51.098140 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2b646567-0da0-4114-98ae-3bed16f57bc5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1264 microversion: 2.1 time: 0.168863 Aug 31 12:01:51.098707 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 679/1371] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:50 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:52.118505 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-bc6915d9-9996-47b4-8076-e056dd5d31c4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:52.119112 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-bc6915d9-9996-47b4-8076-e056dd5d31c4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:52.126398 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc6915d9-9996-47b4-8076-e056dd5d31c4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:52.126873 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc6915d9-9996-47b4-8076-e056dd5d31c4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:52.127300 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc6915d9-9996-47b4-8076-e056dd5d31c4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:52.127988 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc6915d9-9996-47b4-8076-e056dd5d31c4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:52.128439 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc6915d9-9996-47b4-8076-e056dd5d31c4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:52.128885 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-bc6915d9-9996-47b4-8076-e056dd5d31c4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:52.260805 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-bc6915d9-9996-47b4-8076-e056dd5d31c4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:52.268389 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-bc6915d9-9996-47b4-8076-e056dd5d31c4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1264 microversion: 2.1 time: 0.153715 Aug 31 12:01:52.268980 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 693/1372] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:52 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:52.751205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [req-418beee3-7d56-4417-89ac-976c2ea55d05 req-613ee398-f3f1-4271-8d74-06571e495d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e12793d0-9498-496d-87b9-a216a2b2ff21", "name": "network-vif-plugged", "status": "completed", "tag": "47d35fa1-7be5-46c9-8296-5e1d48633480"}]} {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:01:52.763246 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-418beee3-7d56-4417-89ac-976c2ea55d05 req-613ee398-f3f1-4271-8d74-06571e495d67 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:52.763727 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-418beee3-7d56-4417-89ac-976c2ea55d05 req-613ee398-f3f1-4271-8d74-06571e495d67 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:52.764153 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [req-418beee3-7d56-4417-89ac-976c2ea55d05 req-613ee398-f3f1-4271-8d74-06571e495d67 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:52.775415 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.compute.server_external_events [req-418beee3-7d56-4417-89ac-976c2ea55d05 req-613ee398-f3f1-4271-8d74-06571e495d67 service nova] Creating event network-vif-plugged:47d35fa1-7be5-46c9-8296-5e1d48633480 for instance e12793d0-9498-496d-87b9-a216a2b2ff21 on hv-cinder-83976 Aug 31 12:01:52.781628 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [req-418beee3-7d56-4417-89ac-976c2ea55d05 req-613ee398-f3f1-4271-8d74-06571e495d67 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033759 Aug 31 12:01:52.782234 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 680/1373] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 12:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:01:53.288906 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-a17a97d9-0594-494d-a7c3-0f5149f208d5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:53.289516 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-a17a97d9-0594-494d-a7c3-0f5149f208d5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:53.296660 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a17a97d9-0594-494d-a7c3-0f5149f208d5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:53.297137 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a17a97d9-0594-494d-a7c3-0f5149f208d5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:53.297568 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a17a97d9-0594-494d-a7c3-0f5149f208d5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:53.298252 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a17a97d9-0594-494d-a7c3-0f5149f208d5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:53.298705 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a17a97d9-0594-494d-a7c3-0f5149f208d5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:53.299934 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-a17a97d9-0594-494d-a7c3-0f5149f208d5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:53.439352 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-a17a97d9-0594-494d-a7c3-0f5149f208d5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:53.447097 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-a17a97d9-0594-494d-a7c3-0f5149f208d5 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1264 microversion: 2.1 time: 0.162300 Aug 31 12:01:53.447758 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 694/1374] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:53 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:54.469710 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-40b3addd-c08e-49b8-977d-2ac4b113d84b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:54.470295 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-40b3addd-c08e-49b8-977d-2ac4b113d84b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:54.477246 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40b3addd-c08e-49b8-977d-2ac4b113d84b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:54.477724 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40b3addd-c08e-49b8-977d-2ac4b113d84b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:54.478154 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40b3addd-c08e-49b8-977d-2ac4b113d84b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:54.478856 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40b3addd-c08e-49b8-977d-2ac4b113d84b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:54.479336 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40b3addd-c08e-49b8-977d-2ac4b113d84b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:54.479754 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-40b3addd-c08e-49b8-977d-2ac4b113d84b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:54.612451 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-40b3addd-c08e-49b8-977d-2ac4b113d84b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:54.620780 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-40b3addd-c08e-49b8-977d-2ac4b113d84b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1264 microversion: 2.1 time: 0.155214 Aug 31 12:01:54.621380 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 681/1375] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:54 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:55.641728 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-4b575f23-fdb7-424f-a873-9d47d540263b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:55.642340 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-4b575f23-fdb7-424f-a873-9d47d540263b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:55.648837 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4b575f23-fdb7-424f-a873-9d47d540263b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:55.649319 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4b575f23-fdb7-424f-a873-9d47d540263b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:55.649754 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4b575f23-fdb7-424f-a873-9d47d540263b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:55.650458 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4b575f23-fdb7-424f-a873-9d47d540263b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:55.651393 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4b575f23-fdb7-424f-a873-9d47d540263b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:55.651816 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-4b575f23-fdb7-424f-a873-9d47d540263b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:55.780604 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-4b575f23-fdb7-424f-a873-9d47d540263b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:55.788421 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-4b575f23-fdb7-424f-a873-9d47d540263b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1451 microversion: 2.1 time: 0.150572 Aug 31 12:01:55.789013 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 695/1376] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:55 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:55.808649 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-e5b1a121-7d2e-462b-a5b1-bd2a881f1ae1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:01:55.809246 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-e5b1a121-7d2e-462b-a5b1-bd2a881f1ae1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:01:55.815897 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e5b1a121-7d2e-462b-a5b1-bd2a881f1ae1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:55.816365 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e5b1a121-7d2e-462b-a5b1-bd2a881f1ae1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:55.816823 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e5b1a121-7d2e-462b-a5b1-bd2a881f1ae1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:55.817500 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e5b1a121-7d2e-462b-a5b1-bd2a881f1ae1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:55.817938 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e5b1a121-7d2e-462b-a5b1-bd2a881f1ae1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:55.818356 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-e5b1a121-7d2e-462b-a5b1-bd2a881f1ae1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:55.955177 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-e5b1a121-7d2e-462b-a5b1-bd2a881f1ae1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:01:55.962799 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-e5b1a121-7d2e-462b-a5b1-bd2a881f1ae1 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1451 microversion: 2.1 time: 0.158082 Aug 31 12:01:55.963552 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 682/1377] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:01:55 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:01:57.998601 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-1ea301cb-d38b-4d0b-82b4-e0bdf6a452c7 req-2465bcf7-d22e-4b67-a509-897bb775e530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e12793d0-9498-496d-87b9-a216a2b2ff21", "tag": "47d35fa1-7be5-46c9-8296-5e1d48633480"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:01:58.008130 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-1ea301cb-d38b-4d0b-82b4-e0bdf6a452c7 req-2465bcf7-d22e-4b67-a509-897bb775e530 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:01:58.008734 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-1ea301cb-d38b-4d0b-82b4-e0bdf6a452c7 req-2465bcf7-d22e-4b67-a509-897bb775e530 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:01:58.009255 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-1ea301cb-d38b-4d0b-82b4-e0bdf6a452c7 req-2465bcf7-d22e-4b67-a509-897bb775e530 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:01:58.021402 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-1ea301cb-d38b-4d0b-82b4-e0bdf6a452c7 req-2465bcf7-d22e-4b67-a509-897bb775e530 service nova] Creating event network-changed:47d35fa1-7be5-46c9-8296-5e1d48633480 for instance e12793d0-9498-496d-87b9-a216a2b2ff21 on hv-cinder-83976 Aug 31 12:01:58.027990 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-1ea301cb-d38b-4d0b-82b4-e0bdf6a452c7 req-2465bcf7-d22e-4b67-a509-897bb775e530 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168106 Aug 31 12:01:58.028643 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 696/1378] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 12:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:04:00.941403 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a30e49cc-bc96-4397-bf06-1466663856aa] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 12:04:00.941958 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:00.942897 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG dbcounter [-] [127061] Writing DB stats nova_cell1:SELECT=48 {{(pid=127061) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:00.944408 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:04:00.944592 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da098f72-8a9c-4816-8d56-e27c4882f229] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 12:04:00.945413 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Wed Aug 31 12:04:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 (ip 10.222.0.60) !!! Aug 31 12:04:00.945537 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_api:SELECT=22 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:00.945866 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG dbcounter [-] [127062] Writing DB stats nova_cell1:SELECT=50 {{(pid=127062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:00.946654 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:04:00.946776 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Wed Aug 31 12:04:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Aug 31 12:04:00.947898 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 12:04:00.948024 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Wed Aug 31 12:04:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.60) !!! Aug 31 12:04:00.953917 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-80ffb1d9-d8e7-4bd9-b4a8-ca0121dac399 req-f2a68f18-36ca-47b8-aad6-c2a9b35c50fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e12793d0-9498-496d-87b9-a216a2b2ff21", "tag": "47d35fa1-7be5-46c9-8296-5e1d48633480"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:04:00.962434 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-3c4eb660-0da5-47a3-8588-d7ede293cdbc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:04:00.963260 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3c4eb660-0da5-47a3-8588-d7ede293cdbc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:04:00.968770 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-80ffb1d9-d8e7-4bd9-b4a8-ca0121dac399 req-f2a68f18-36ca-47b8-aad6-c2a9b35c50fb service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:00.969080 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-80ffb1d9-d8e7-4bd9-b4a8-ca0121dac399 req-f2a68f18-36ca-47b8-aad6-c2a9b35c50fb service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:00.969450 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-80ffb1d9-d8e7-4bd9-b4a8-ca0121dac399 req-f2a68f18-36ca-47b8-aad6-c2a9b35c50fb service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:00.973907 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3c4eb660-0da5-47a3-8588-d7ede293cdbc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:00.976671 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3c4eb660-0da5-47a3-8588-d7ede293cdbc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:00.977480 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3c4eb660-0da5-47a3-8588-d7ede293cdbc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:00.977875 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3c4eb660-0da5-47a3-8588-d7ede293cdbc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:00.978327 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3c4eb660-0da5-47a3-8588-d7ede293cdbc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:00.978749 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-3c4eb660-0da5-47a3-8588-d7ede293cdbc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:00.984853 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-80ffb1d9-d8e7-4bd9-b4a8-ca0121dac399 req-f2a68f18-36ca-47b8-aad6-c2a9b35c50fb service nova] Creating event network-changed:47d35fa1-7be5-46c9-8296-5e1d48633480 for instance e12793d0-9498-496d-87b9-a216a2b2ff21 on hv-cinder-83976 Aug 31 12:04:00.991451 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-80ffb1d9-d8e7-4bd9-b4a8-ca0121dac399 req-f2a68f18-36ca-47b8-aad6-c2a9b35c50fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047806 Aug 31 12:04:00.992294 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 697/1379] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 12:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:04:01.017557 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-3c4eb660-0da5-47a3-8588-d7ede293cdbc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Going to try to terminate instance {{(pid=127061) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:04:01.110241 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-3c4eb660-0da5-47a3-8588-d7ede293cdbc tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 204 len: 0 microversion: 2.1 time: 0.171027 Aug 31 12:04:01.111711 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 683/1380] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 12:04:00 2022] DELETE /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:04:01.121819 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-fd6ec49a-b614-4b79-b11f-5961ecc6648c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:04:01.122447 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-fd6ec49a-b614-4b79-b11f-5961ecc6648c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:04:01.132073 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd6ec49a-b614-4b79-b11f-5961ecc6648c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:01.133828 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd6ec49a-b614-4b79-b11f-5961ecc6648c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:01.135012 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd6ec49a-b614-4b79-b11f-5961ecc6648c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:01.137310 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd6ec49a-b614-4b79-b11f-5961ecc6648c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:01.137976 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd6ec49a-b614-4b79-b11f-5961ecc6648c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:01.139088 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-fd6ec49a-b614-4b79-b11f-5961ecc6648c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:01.457502 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-fd6ec49a-b614-4b79-b11f-5961ecc6648c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:04:01.465984 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-fd6ec49a-b614-4b79-b11f-5961ecc6648c tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1576 microversion: 2.1 time: 0.349304 Aug 31 12:04:01.466563 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 698/1381] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:04:01 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1576 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:04:02.489276 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-4c5626f3-f20b-4435-89f6-1f6289d29955 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:04:02.490693 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-4c5626f3-f20b-4435-89f6-1f6289d29955 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:04:02.502429 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO oslo.messaging._drivers.impl_rabbit [-] [a30e49cc-bc96-4397-bf06-1466663856aa] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 36238. Aug 31 12:04:02.507427 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c5626f3-f20b-4435-89f6-1f6289d29955 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:02.507907 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c5626f3-f20b-4435-89f6-1f6289d29955 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:02.508339 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c5626f3-f20b-4435-89f6-1f6289d29955 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:02.509084 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c5626f3-f20b-4435-89f6-1f6289d29955 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:02.509527 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c5626f3-f20b-4435-89f6-1f6289d29955 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:02.509955 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-4c5626f3-f20b-4435-89f6-1f6289d29955 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:02.744606 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-4c5626f3-f20b-4435-89f6-1f6289d29955 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:04:02.753598 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-4c5626f3-f20b-4435-89f6-1f6289d29955 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1576 microversion: 2.1 time: 0.268629 Aug 31 12:04:02.754198 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 684/1382] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:04:02 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1576 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:04:03.421516 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-729c556d-8967-4e6e-970b-9427491b7ad1 req-c38a420d-bafd-444c-8ae4-6284cf11dd5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e12793d0-9498-496d-87b9-a216a2b2ff21", "name": "network-vif-deleted", "tag": "47d35fa1-7be5-46c9-8296-5e1d48633480"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:04:03.435724 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-729c556d-8967-4e6e-970b-9427491b7ad1 req-c38a420d-bafd-444c-8ae4-6284cf11dd5b service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:03.437461 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-729c556d-8967-4e6e-970b-9427491b7ad1 req-c38a420d-bafd-444c-8ae4-6284cf11dd5b service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:03.437461 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-729c556d-8967-4e6e-970b-9427491b7ad1 req-c38a420d-bafd-444c-8ae4-6284cf11dd5b service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:03.448927 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO oslo.messaging._drivers.impl_rabbit [-] [da098f72-8a9c-4816-8d56-e27c4882f229] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 36244. Aug 31 12:04:03.451339 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-729c556d-8967-4e6e-970b-9427491b7ad1 req-c38a420d-bafd-444c-8ae4-6284cf11dd5b service nova] Creating event network-vif-deleted:47d35fa1-7be5-46c9-8296-5e1d48633480 for instance e12793d0-9498-496d-87b9-a216a2b2ff21 on hv-cinder-83976 Aug 31 12:04:03.458796 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-729c556d-8967-4e6e-970b-9427491b7ad1 req-c38a420d-bafd-444c-8ae4-6284cf11dd5b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039312 Aug 31 12:04:03.458796 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 699/1383] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 12:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:04:03.777765 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-2b944575-f8a5-4a13-b6f1-61382495610e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:04:03.778449 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-2b944575-f8a5-4a13-b6f1-61382495610e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:04:03.785163 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b944575-f8a5-4a13-b6f1-61382495610e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:03.785960 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b944575-f8a5-4a13-b6f1-61382495610e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:03.786793 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b944575-f8a5-4a13-b6f1-61382495610e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:03.787804 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b944575-f8a5-4a13-b6f1-61382495610e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:03.787984 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b944575-f8a5-4a13-b6f1-61382495610e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:03.788431 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b944575-f8a5-4a13-b6f1-61382495610e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:03.831996 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b944575-f8a5-4a13-b6f1-61382495610e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:03.832432 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b944575-f8a5-4a13-b6f1-61382495610e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:03.833135 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-2b944575-f8a5-4a13-b6f1-61382495610e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:03.834191 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-2b944575-f8a5-4a13-b6f1-61382495610e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lazy-loading 'fault' on Instance uuid e12793d0-9498-496d-87b9-a216a2b2ff21 {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:04:03.881610 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-2b944575-f8a5-4a13-b6f1-61382495610e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:04:03.890088 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-2b944575-f8a5-4a13-b6f1-61382495610e tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 200 len: 1229 microversion: 2.1 time: 0.116299 Aug 31 12:04:03.890673 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 685/1384] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:04:03 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 1229 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:04:04.912830 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5ce26715-edf8-42fb-bb67-b9ec10e49a3b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:04:04.914496 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-5ce26715-edf8-42fb-bb67-b9ec10e49a3b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: e12793d0-9498-496d-87b9-a216a2b2ff21] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:04:04.922575 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ce26715-edf8-42fb-bb67-b9ec10e49a3b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:04.923095 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ce26715-edf8-42fb-bb67-b9ec10e49a3b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:04.923601 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ce26715-edf8-42fb-bb67-b9ec10e49a3b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:04.924416 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ce26715-edf8-42fb-bb67-b9ec10e49a3b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:04.924975 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ce26715-edf8-42fb-bb67-b9ec10e49a3b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:04.925451 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-5ce26715-edf8-42fb-bb67-b9ec10e49a3b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:04.945849 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-5ce26715-edf8-42fb-bb67-b9ec10e49a3b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] HTTP exception thrown: Instance e12793d0-9498-496d-87b9-a216a2b2ff21 could not be found. Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5ce26715-edf8-42fb-bb67-b9ec10e49a3b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Request method failure captured: Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 HTTP/1.1 Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0xPTp-Y3MFRJFHKxfVTyL9rMnJSH4hjHNXzhqXB6tm8dm4AU7iM_h9a4ESswNHevMhyY6zQsWgUS5GDNCONb_OxExbxDImmRj8M9g_GexrsaYMbIXuTXfJwF55gUCA_6fKJatOU_HrjiT8j20nujvcE5PCuI2AiyV6AvZlxW-f5P60 Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: fe46592aea54410c9f49a0371bb2bc73 Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-TestVolumeBootPattern-1786440814 Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 12:04:04.947673 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 12:04:04.949565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fe46592aea54410c9f49a0371bb2bc73", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fe46592aea54410c9f49a0371bb2bc73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe46592aea54410c9f49a0371bb2bc73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe46592aea54410c9f49a0371bb2bc73"}]}] Aug 31 12:04:04.949565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-TestVolumeBootPattern-1786440814 Aug 31 12:04:04.949565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: fe46592aea54410c9f49a0371bb2bc73 Aug 31 12:04:04.949565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-TestVolumeBootPattern-1786440814 Aug 31 12:04:04.949565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-TestVolumeBootPattern-1786440814-project Aug 31 12:04:04.949565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 12:04:04.949565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 12:04:04.949565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: c6d4923a511342248e34954fc44811c0 Aug 31 12:04:04.949565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-TestVolumeBootPattern-1786440814-project Aug 31 12:04:04.949565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 12:04:04.949565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance e12793d0-9498-496d-87b9-a216a2b2ff21 could not be found. Aug 31 12:04:04.949565 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': 'e12793d0-9498-496d-87b9-a216a2b2ff21'} Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e12793d0-9498-496d-87b9-a216a2b2ff21 could not be found. Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:04:04.950621 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e12793d0-9498-496d-87b9-a216a2b2ff21 could not be found. Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e12793d0-9498-496d-87b9-a216a2b2ff21 could not be found. Aug 31 12:04:04.952411 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 12:04:04.954081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-5ce26715-edf8-42fb-bb67-b9ec10e49a3b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Returning 404 to user: Instance e12793d0-9498-496d-87b9-a216a2b2ff21 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:04:04.954081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-5ce26715-edf8-42fb-bb67-b9ec10e49a3b tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21" status: 404 len: 111 microversion: 2.1 time: 0.041468 Aug 31 12:04:04.954081 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 700/1385] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:04:04 2022] GET /compute/v2.1/servers/e12793d0-9498-496d-87b9-a216a2b2ff21 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:04:08.380714 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-8170b3d8-587c-4903-8b54-1e9b97f3a407 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:04:08.381412 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8170b3d8-587c-4903-8b54-1e9b97f3a407 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:04:08.384283 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-402ec761-2da7-4815-818b-781279058349 req-ac20e93b-4660-4dc4-be5d-7230122cc805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9b95af1-7e84-496f-ad1b-fb76d9611cef", "tag": "9755e47d-a274-473e-80af-183c6e2a483a"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:04:08.388589 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8170b3d8-587c-4903-8b54-1e9b97f3a407 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:08.389323 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8170b3d8-587c-4903-8b54-1e9b97f3a407 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:08.389857 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8170b3d8-587c-4903-8b54-1e9b97f3a407 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:08.390682 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8170b3d8-587c-4903-8b54-1e9b97f3a407 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:08.391222 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8170b3d8-587c-4903-8b54-1e9b97f3a407 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:08.391716 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-8170b3d8-587c-4903-8b54-1e9b97f3a407 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:08.394967 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-402ec761-2da7-4815-818b-781279058349 req-ac20e93b-4660-4dc4-be5d-7230122cc805 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:08.395452 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-402ec761-2da7-4815-818b-781279058349 req-ac20e93b-4660-4dc4-be5d-7230122cc805 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:08.395922 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-402ec761-2da7-4815-818b-781279058349 req-ac20e93b-4660-4dc4-be5d-7230122cc805 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:08.409269 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-402ec761-2da7-4815-818b-781279058349 req-ac20e93b-4660-4dc4-be5d-7230122cc805 service nova] Creating event network-changed:9755e47d-a274-473e-80af-183c6e2a483a for instance d9b95af1-7e84-496f-ad1b-fb76d9611cef on hv-cinder-83976 Aug 31 12:04:08.416058 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-402ec761-2da7-4815-818b-781279058349 req-ac20e93b-4660-4dc4-be5d-7230122cc805 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035273 Aug 31 12:04:08.416699 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 701/1386] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 12:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 12:04:08.420691 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-8170b3d8-587c-4903-8b54-1e9b97f3a407 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Going to try to terminate instance {{(pid=127061) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 12:04:08.528789 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-8170b3d8-587c-4903-8b54-1e9b97f3a407 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 204 len: 0 microversion: 2.1 time: 0.151720 Aug 31 12:04:08.529760 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 686/1387] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 12:04:08 2022] DELETE /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 12:04:08.540140 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-e296473d-ec51-43de-be72-a1c426cbde92 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:04:08.541087 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-e296473d-ec51-43de-be72-a1c426cbde92 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:04:08.548296 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e296473d-ec51-43de-be72-a1c426cbde92 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:08.548830 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e296473d-ec51-43de-be72-a1c426cbde92 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:08.549390 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e296473d-ec51-43de-be72-a1c426cbde92 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:08.550179 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e296473d-ec51-43de-be72-a1c426cbde92 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:08.550685 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e296473d-ec51-43de-be72-a1c426cbde92 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:08.551112 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-e296473d-ec51-43de-be72-a1c426cbde92 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:08.712852 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.policy [None req-e296473d-ec51-43de-be72-a1c426cbde92 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127062) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:04:08.722796 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-e296473d-ec51-43de-be72-a1c426cbde92 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1576 microversion: 2.1 time: 0.187807 Aug 31 12:04:08.724534 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 702/1388] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:04:08 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 12:04:09.747552 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-07674c5e-9a6b-4de1-b75c-7f7356bd8426 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:04:09.748242 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-07674c5e-9a6b-4de1-b75c-7f7356bd8426 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:04:09.754896 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-07674c5e-9a6b-4de1-b75c-7f7356bd8426 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:09.755921 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-07674c5e-9a6b-4de1-b75c-7f7356bd8426 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:09.756779 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-07674c5e-9a6b-4de1-b75c-7f7356bd8426 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:09.757510 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-07674c5e-9a6b-4de1-b75c-7f7356bd8426 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:09.758337 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-07674c5e-9a6b-4de1-b75c-7f7356bd8426 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:09.758764 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-07674c5e-9a6b-4de1-b75c-7f7356bd8426 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:09.956239 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-07674c5e-9a6b-4de1-b75c-7f7356bd8426 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:04:09.964801 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-07674c5e-9a6b-4de1-b75c-7f7356bd8426 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1576 microversion: 2.1 time: 0.221557 Aug 31 12:04:09.965369 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 687/1389] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:04:09 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:04:10.593644 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [req-c57dc0f1-2357-403b-b42c-2307a33c0bbd req-ac119fcd-be22-4a61-9d2b-283dd0fd18d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b95af1-7e84-496f-ad1b-fb76d9611cef", "name": "network-vif-deleted", "tag": "9755e47d-a274-473e-80af-183c6e2a483a"}]} {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 12:04:10.605873 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-c57dc0f1-2357-403b-b42c-2307a33c0bbd req-ac119fcd-be22-4a61-9d2b-283dd0fd18d9 service nova] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:10.607175 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-c57dc0f1-2357-403b-b42c-2307a33c0bbd req-ac119fcd-be22-4a61-9d2b-283dd0fd18d9 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:10.607625 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [req-c57dc0f1-2357-403b-b42c-2307a33c0bbd req-ac119fcd-be22-4a61-9d2b-283dd0fd18d9 service nova] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:10.621885 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.compute.server_external_events [req-c57dc0f1-2357-403b-b42c-2307a33c0bbd req-ac119fcd-be22-4a61-9d2b-283dd0fd18d9 service nova] Creating event network-vif-deleted:9755e47d-a274-473e-80af-183c6e2a483a for instance d9b95af1-7e84-496f-ad1b-fb76d9611cef on hv-cinder-83976 Aug 31 12:04:10.627186 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [req-c57dc0f1-2357-403b-b42c-2307a33c0bbd req-ac119fcd-be22-4a61-9d2b-283dd0fd18d9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037286 Aug 31 12:04:10.627796 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 703/1390] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Aug 31 12:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 12:04:10.986162 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-aea239ab-dc30-4fde-a190-5c5fa6191d73 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:04:10.986849 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-aea239ab-dc30-4fde-a190-5c5fa6191d73 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:04:10.994644 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aea239ab-dc30-4fde-a190-5c5fa6191d73 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:10.995205 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aea239ab-dc30-4fde-a190-5c5fa6191d73 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:10.995675 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aea239ab-dc30-4fde-a190-5c5fa6191d73 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:10.996443 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aea239ab-dc30-4fde-a190-5c5fa6191d73 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:10.996951 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aea239ab-dc30-4fde-a190-5c5fa6191d73 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:10.997401 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aea239ab-dc30-4fde-a190-5c5fa6191d73 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:11.035225 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aea239ab-dc30-4fde-a190-5c5fa6191d73 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:11.035733 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aea239ab-dc30-4fde-a190-5c5fa6191d73 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:11.036185 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-aea239ab-dc30-4fde-a190-5c5fa6191d73 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:11.037334 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.objects.instance [None req-aea239ab-dc30-4fde-a190-5c5fa6191d73 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lazy-loading 'fault' on Instance uuid d9b95af1-7e84-496f-ad1b-fb76d9611cef {{(pid=127061) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 12:04:11.079854 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.policy [None req-aea239ab-dc30-4fde-a190-5c5fa6191d73 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6d4923a511342248e34954fc44811c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe46592aea54410c9f49a0371bb2bc73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127061) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 12:04:11.090275 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-aea239ab-dc30-4fde-a190-5c5fa6191d73 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 200 len: 1230 microversion: 2.1 time: 0.107903 Aug 31 12:04:11.091036 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 688/1391] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:04:10 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 12:04:12.117094 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3b31a9dc-805e-4921-a62c-982793264ee4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:04:12.117788 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-3b31a9dc-805e-4921-a62c-982793264ee4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: d9b95af1-7e84-496f-ad1b-fb76d9611cef] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:04:12.124429 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3b31a9dc-805e-4921-a62c-982793264ee4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:12.124976 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3b31a9dc-805e-4921-a62c-982793264ee4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:12.125471 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3b31a9dc-805e-4921-a62c-982793264ee4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:12.126244 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3b31a9dc-805e-4921-a62c-982793264ee4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:12.126879 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3b31a9dc-805e-4921-a62c-982793264ee4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:12.127340 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-3b31a9dc-805e-4921-a62c-982793264ee4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:12.143816 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-3b31a9dc-805e-4921-a62c-982793264ee4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] HTTP exception thrown: Instance d9b95af1-7e84-496f-ad1b-fb76d9611cef could not be found. Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3b31a9dc-805e-4921-a62c-982793264ee4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Request method failure captured: Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef HTTP/1.1 Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0xPTp-Y3MFRJFHKxfVTyL9rMnJSH4hjHNXzhqXB6tm8dm4AU7iM_h9a4ESswNHevMhyY6zQsWgUS5GDNCONb_OxExbxDImmRj8M9g_GexrsaYMbIXuTXfJwF55gUCA_6fKJatOU_HrjiT8j20nujvcE5PCuI2AiyV6AvZlxW-f5P60 Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: fe46592aea54410c9f49a0371bb2bc73 Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-TestVolumeBootPattern-1786440814 Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 12:04:12.145627 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 12:04:12.147692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fe46592aea54410c9f49a0371bb2bc73", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fe46592aea54410c9f49a0371bb2bc73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe46592aea54410c9f49a0371bb2bc73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe46592aea54410c9f49a0371bb2bc73"}]}] Aug 31 12:04:12.147692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-TestVolumeBootPattern-1786440814 Aug 31 12:04:12.147692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: fe46592aea54410c9f49a0371bb2bc73 Aug 31 12:04:12.147692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-TestVolumeBootPattern-1786440814 Aug 31 12:04:12.147692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-TestVolumeBootPattern-1786440814-project Aug 31 12:04:12.147692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 12:04:12.147692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 12:04:12.147692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: c6d4923a511342248e34954fc44811c0 Aug 31 12:04:12.147692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-TestVolumeBootPattern-1786440814-project Aug 31 12:04:12.147692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 12:04:12.147692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance d9b95af1-7e84-496f-ad1b-fb76d9611cef could not be found. Aug 31 12:04:12.147692 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': 'd9b95af1-7e84-496f-ad1b-fb76d9611cef'} Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9b95af1-7e84-496f-ad1b-fb76d9611cef could not be found. Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:04:12.148652 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9b95af1-7e84-496f-ad1b-fb76d9611cef could not be found. Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9b95af1-7e84-496f-ad1b-fb76d9611cef could not be found. Aug 31 12:04:12.150038 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 12:04:12.151299 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-3b31a9dc-805e-4921-a62c-982793264ee4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Returning 404 to user: Instance d9b95af1-7e84-496f-ad1b-fb76d9611cef could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:04:12.151299 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-3b31a9dc-805e-4921-a62c-982793264ee4 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef" status: 404 len: 111 microversion: 2.1 time: 0.036125 Aug 31 12:04:12.151299 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 704/1392] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:04:12 2022] GET /compute/v2.1/servers/d9b95af1-7e84-496f-ad1b-fb76d9611cef => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:04:12.612332 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6eebb2d4-e13b-4795-af52-ac53c1995071 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:04:12.613111 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.compute.api [None req-6eebb2d4-e13b-4795-af52-ac53c1995071 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127061) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:04:12.622150 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6eebb2d4-e13b-4795-af52-ac53c1995071 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:12.622749 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6eebb2d4-e13b-4795-af52-ac53c1995071 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:12.623330 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6eebb2d4-e13b-4795-af52-ac53c1995071 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:12.624325 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6eebb2d4-e13b-4795-af52-ac53c1995071 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:12.625014 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6eebb2d4-e13b-4795-af52-ac53c1995071 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:12.625650 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG oslo_concurrency.lockutils [None req-6eebb2d4-e13b-4795-af52-ac53c1995071 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:12.644321 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.wsgi [None req-6eebb2d4-e13b-4795-af52-ac53c1995071 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] HTTP exception thrown: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6eebb2d4-e13b-4795-af52-ac53c1995071 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Request method failure captured: Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: request: DELETE /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 HTTP/1.1 Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept: application/json Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Accept-Encoding: identity Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Connection: close Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Length: 0 Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Content-Type: application/json Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Host: 10.222.0.60 Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: Openstack-System-Scope: None Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: User-Agent: python-urllib3/1.26.12 Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Auth-Token: gAAAAABjD0xPTp-Y3MFRJFHKxfVTyL9rMnJSH4hjHNXzhqXB6tm8dm4AU7iM_h9a4ESswNHevMhyY6zQsWgUS5GDNCONb_OxExbxDImmRj8M9g_GexrsaYMbIXuTXfJwF55gUCA_6fKJatOU_HrjiT8j20nujvcE5PCuI2AiyV6AvZlxW-f5P60 Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Id: None Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Domain-Name: None Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Identity-Status: Confirmed Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Is-Admin-Project: True Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Id: default Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Domain-Name: Default Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Id: fe46592aea54410c9f49a0371bb2bc73 Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Project-Name: tempest-TestVolumeBootPattern-1786440814 Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Role: reader,member Aug 31 12:04:12.647688 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Roles: reader,member Aug 31 12:04:12.649855 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fe46592aea54410c9f49a0371bb2bc73", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fe46592aea54410c9f49a0371bb2bc73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe46592aea54410c9f49a0371bb2bc73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe46592aea54410c9f49a0371bb2bc73"}]}] Aug 31 12:04:12.649855 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant: tempest-TestVolumeBootPattern-1786440814 Aug 31 12:04:12.649855 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Id: fe46592aea54410c9f49a0371bb2bc73 Aug 31 12:04:12.649855 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-Tenant-Name: tempest-TestVolumeBootPattern-1786440814 Aug 31 12:04:12.649855 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User: tempest-TestVolumeBootPattern-1786440814-project Aug 31 12:04:12.649855 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Id: default Aug 31 12:04:12.649855 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Domain-Name: Default Aug 31 12:04:12.649855 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Id: c6d4923a511342248e34954fc44811c0 Aug 31 12:04:12.649855 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: X-User-Name: tempest-TestVolumeBootPattern-1786440814-project Aug 31 12:04:12.649855 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: method: > Aug 31 12:04:12.649855 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: exception: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. Aug 31 12:04:12.649855 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: action_args: {'id': '3c016285-8d0b-49ea-9722-3ec6f878f274'} Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:04:12.650943 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. Aug 31 12:04:12.652652 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: ERROR nova.api.openstack.wsgi Aug 31 12:04:12.654442 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6eebb2d4-e13b-4795-af52-ac53c1995071 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Returning 404 to user: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. {{(pid=127061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:04:12.654442 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6eebb2d4-e13b-4795-af52-ac53c1995071 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 404 len: 111 microversion: 2.1 time: 0.042796 Aug 31 12:04:12.654442 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 689/1393] 10.222.0.60 () {58 vars in 1239 bytes} [Wed Aug 31 12:04:12 2022] DELETE /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:04:12.660979 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b06e7eb1-e687-4180-a971-702523ad0d17 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '>' {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:04:12.662426 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.compute.api [None req-b06e7eb1-e687-4180-a971-702523ad0d17 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] [instance: 3c016285-8d0b-49ea-9722-3ec6f878f274] Fetching instance by UUID {{(pid=127062) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 12:04:12.670263 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b06e7eb1-e687-4180-a971-702523ad0d17 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:12.670854 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b06e7eb1-e687-4180-a971-702523ad0d17 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:12.671470 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b06e7eb1-e687-4180-a971-702523ad0d17 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:12.672440 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b06e7eb1-e687-4180-a971-702523ad0d17 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Acquiring lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 12:04:12.673042 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b06e7eb1-e687-4180-a971-702523ad0d17 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 12:04:12.673646 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG oslo_concurrency.lockutils [None req-b06e7eb1-e687-4180-a971-702523ad0d17 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Lock "9e384889-6636-4480-9f30-0e4cdfea2d8c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 12:04:12.693407 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.wsgi [None req-b06e7eb1-e687-4180-a971-702523ad0d17 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] HTTP exception thrown: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b06e7eb1-e687-4180-a971-702523ad0d17 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Request method failure captured: Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: request: GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 HTTP/1.1 Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept: application/json Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Accept-Encoding: identity Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Connection: close Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Length: 0 Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Content-Type: application/json Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Host: 10.222.0.60 Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: Openstack-System-Scope: None Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: User-Agent: python-urllib3/1.26.12 Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Auth-Token: gAAAAABjD0xPTp-Y3MFRJFHKxfVTyL9rMnJSH4hjHNXzhqXB6tm8dm4AU7iM_h9a4ESswNHevMhyY6zQsWgUS5GDNCONb_OxExbxDImmRj8M9g_GexrsaYMbIXuTXfJwF55gUCA_6fKJatOU_HrjiT8j20nujvcE5PCuI2AiyV6AvZlxW-f5P60 Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Id: None Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Domain-Name: None Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Identity-Status: Confirmed Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Is-Admin-Project: True Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Id: default Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Domain-Name: Default Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Id: fe46592aea54410c9f49a0371bb2bc73 Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Project-Name: tempest-TestVolumeBootPattern-1786440814 Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Role: reader,member Aug 31 12:04:12.695535 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Roles: reader,member Aug 31 12:04:12.697377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_fe46592aea54410c9f49a0371bb2bc73", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/fe46592aea54410c9f49a0371bb2bc73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe46592aea54410c9f49a0371bb2bc73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/fe46592aea54410c9f49a0371bb2bc73"}]}] Aug 31 12:04:12.697377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant: tempest-TestVolumeBootPattern-1786440814 Aug 31 12:04:12.697377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Id: fe46592aea54410c9f49a0371bb2bc73 Aug 31 12:04:12.697377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-Tenant-Name: tempest-TestVolumeBootPattern-1786440814 Aug 31 12:04:12.697377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User: tempest-TestVolumeBootPattern-1786440814-project Aug 31 12:04:12.697377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Id: default Aug 31 12:04:12.697377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Domain-Name: Default Aug 31 12:04:12.697377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Id: c6d4923a511342248e34954fc44811c0 Aug 31 12:04:12.697377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: X-User-Name: tempest-TestVolumeBootPattern-1786440814-project Aug 31 12:04:12.697377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: method: > Aug 31 12:04:12.697377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: exception: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. Aug 31 12:04:12.697377 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: action_args: {'id': '3c016285-8d0b-49ea-9722-3ec6f878f274'} Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: {{(pid=127062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 12:04:12.698437 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. Aug 31 12:04:12.700181 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: ERROR nova.api.openstack.wsgi Aug 31 12:04:12.701837 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: DEBUG nova.api.openstack.wsgi [None req-b06e7eb1-e687-4180-a971-702523ad0d17 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Returning 404 to user: Instance 3c016285-8d0b-49ea-9722-3ec6f878f274 could not be found. {{(pid=127062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 12:04:12.701837 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: INFO nova.api.openstack.requestlog [None req-b06e7eb1-e687-4180-a971-702523ad0d17 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274" status: 404 len: 111 microversion: 2.1 time: 0.041459 Aug 31 12:04:12.701837 dv-cinder-839768-3-iscsi devstack@n-api.service[127062]: [pid: 127062|app: 0|req: 705/1394] 10.222.0.60 () {58 vars in 1236 bytes} [Wed Aug 31 12:04:12 2022] GET /compute/v2.1/servers/3c016285-8d0b-49ea-9722-3ec6f878f274 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 12:04:14.024447 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: DEBUG nova.api.openstack.wsgi [None req-6b4a3a7b-1f3c-4ea7-a646-658b68032b00 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] Calling method '.version_select at 0x7f173805f9d0>' {{(pid=127061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 12:04:14.058867 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: INFO nova.api.openstack.requestlog [None req-6b4a3a7b-1f3c-4ea7-a646-658b68032b00 tempest-TestVolumeBootPattern-1786440814 tempest-TestVolumeBootPattern-1786440814-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-379067288" status: 202 len: 0 microversion: 2.1 time: 0.039554 Aug 31 12:04:14.059778 dv-cinder-839768-3-iscsi devstack@n-api.service[127061]: [pid: 127061|app: 0|req: 690/1395] 10.222.0.60 () {58 vars in 1260 bytes} [Wed Aug 31 12:04:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-379067288 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)